00000001:02000400:0.0F:1790946276.743461:0:2959:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1790946292.897171:0:3178:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing load_modules_local 00000001:01000000:3.0:1790946294.355177:0:3237:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 811 MB/s 00000001:01000000:3.0:1790946294.604469:0:3237:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 839 MB/s 00000001:01000000:3.0:1790946294.854294:0:3237:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 8575 MB/s 00000020:02000000:1.0F:1790946295.422078:0:3269:0:(class_obd.c:846:obdclass_init()) Lustre: Build Version: 2.17.59_3_g5d853fc 00000400:02000000:0.0:1790946296.245313:0:3284:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.203.113@tcp [8/256/0/180] 00008000:02000000:2.0F:1790946299.280397:0:3434:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1790946346.063532:0:5237:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1790946356.416506:0:5815:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1790946356.416513:0:5815:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1790946356.416657:0:5815:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000005e7f43b8 00000080:02000400:2.0:1790946356.416668:0:5815:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' or install '{/usr}/sbin/mount.lustre_tgt' 00000020:01000004:2.0:1790946356.423745:0:5815:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1790946356.423759:0:5815:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1790946356.423947:0:5815:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000e44bae9b) 00000020:00000080:3.0:1790946356.423975:0:5815:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1790946356.436932:0:5815:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1790946356.437475:0:5815:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1790946356.454337:0:5815:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1790946356.454379:0:5815:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1790946356.454402:0:5815:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1790946356.454454:0:5815:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1790946356.454481:0:5815:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1790946356.454961:0:5815:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1790946356.454969:0:5815:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1790946356.454978:0:5815:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x16e41aef93271956 00000020:01000004:0.0:1790946356.454985:0:5815:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1790946356.454989:0:5815:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1790946356.454994:0:5815:0:(tgt_mount.c:101:server_register_mount()) register mount 000000005e7f43b8 from MGS 00000020:01000004:0.0:1790946356.454998:0:5815:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1790946356.455015:0:5815:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000d89ade99) 00000020:00000080:0.0:1790946356.455026:0:5815:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1790946356.455139:0:5815:0:(tgt_mount.c:153:server_get_mount()) get mount 000000005e7f43b8 from MGS, refs=2 00080000:01000000:0.0:1790946356.455144:0:5815:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1790946356.455151:0:5815:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x16e41aef93271964 00000100:00100000:0.0:1790946356.455354:0:5815:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1790946356.455507:0:5815:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1790946356.455513:0:5815:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1790946356.456055:0:5815:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1790946356.456061:0:5815:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1790946356.456867:0:5815:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790946356.457020:0:5815:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1790946356.457024:0:5815:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1790946356.457639:0:5815:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1790946356.457646:0:5815:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1790946356.457933:0:5815:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1790946356.457939:0:5815:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1790946356.458640:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946356.458644:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946356.458646:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946356.458913:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946356.458916:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946356.458918:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946356.459529:0:5815:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1790946356.461824:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1790946356.709293:0:5815:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2363 MB/s 00000001:01000000:3.0:1790946356.959291:0:5815:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3303 MB/s 00000001:01000000:2.0:1790946357.213751:0:5815:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 326 MB/s 00000001:01000000:1.0:1790946357.463794:0:5815:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 523 MB/s 00080000:10000000:1.0:1790946357.478976:0:5815:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:3.0:1790946357.488361:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1790946357.503475:0:5815:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1790946357.503503:0:5815:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1790946357.503506:0:5815:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1790946357.518781:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1790946357.519031:0:5815:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1790946357.519123:0:5815:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1790946357.519454:0:5815:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1790946357.519483:0:5815:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1790946357.519853:0:5815:0:(service.c:173:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790946357.520059:0:5815:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1790946357.520078:0:5815:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1790946357.523808:0:5815:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1790946357.523827:0:5815:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1790946357.524281:0:5815:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1790946357.524288:0:5815:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1790946357.524944:0:5815:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1790946357.524967:0:5815:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.113@tcp' 00000020:01000004:1.0:1790946357.524969:0:5815:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1790946357.525022:0:5815:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.113@tcp (typ=mgc) 00000020:00000080:1.0:1790946357.525044:0:5815:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.113@tcp (00000000d79fe95d) 00000020:00000080:1.0:1790946357.525061:0:5815:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1790946357.526741:0:5815:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000f28e1344@MGC192.168.203.113@tcp: add connection 192.168.203.113@tcp at head 00010000:00010000:1.0:1790946357.526949:0:5815:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.113@tcp-0 is initialized 00000040:01000000:1.0:1790946357.526956:0:5815:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.113@tcp ctxt 1 is initialized 00000100:00080000:0.0:1790946357.527328:0:5830:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1790946357.530005:0:5831:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1790946357.530098:0:5815:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.113@tcp (uuid 5054f39f-0b4d-4846-a244-9f8dda5fa3cd) 00000020:00000080:3.0:1790946357.530131:0:5815:0:(genops.c:1384:class_connect()) connect: client 5054f39f-0b4d-4846-a244-9f8dda5fa3cd, cookie 0x16e41aef93271972 00000100:00080000:3.0:1790946357.530142:0:5815:0:(import.c:545:import_select_connection()) MGC192.168.203.113@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790946357.530153:0:5815:0:(import.c:666:import_select_connection()) MGC192.168.203.113@tcp: import 00000000f28e1344 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:3.0:1790946357.530240:0:5815:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e2d7cc62 x1877943303274624/t0(0) o250->MGC192.168.203.113@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790946357.530269:0:5815:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 5054f39f-0b4d-4846-a244-9f8dda5fa3cd->MGS 00000020:01000004:3.0:1790946357.530292:0:5815:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1790946357.530297:0:5815:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1790946357.530310:0:5815:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000030d16fa8) 00000020:00000080:3.0:1790946357.530323:0:5815:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1790946357.530929:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e2d7cc62 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3299:1877943303274624:0@lo:250: 00000100:00100000:2.0:1790946357.531037:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946357.531277:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303274624 00000100:00100000:1.0:1790946357.531285:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303274624 00000100:00100000:1.0:1790946357.531316:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790946357.531324:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000ffff994b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3299:x1877943303274624:12345-0@lo:250: 00010000:00080000:1.0:1790946357.531363:0:5827:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 5054f39f-0b4d-4846-a244-9f8dda5fa3cd@0@lo t0 exp 0000000000000000 cur 142 last 0 00000020:00000080:1.0:1790946357.531386:0:5827:0:(genops.c:1384:class_connect()) connect: client 5054f39f-0b4d-4846-a244-9f8dda5fa3cd, cookie 0x16e41aef93271980 00000100:00080000:1.0:1790946357.531533:0:5827:0:(import.c:65:import_set_state_nolock()) 000000003067aac9 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790946357.531600:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000ffff994b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+5:3299:x1877943303274624:12345-0@lo:250: Request processed in 276us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946357.531615:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790946357.531875:0:3299:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.113@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1790946357.531884:0:3299:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.113@tcp: connect to target with instance 0 00000100:00080000:2.0:1790946357.531890:0:3299:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.113@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1790946357.531894:0:3299:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1790946357.531897:0:3299:0:(import.c:65:import_set_state_nolock()) 00000000f28e1344 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1790946357.531901:0:3299:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1790946357.531916:0:3299:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1790946357.531921:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e2d7cc62 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3299:1877943303274624:0@lo:250: 00000100:00100000:3.0:1790946357.581930:0:5815:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790946357.582167:0:5815:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1790946357.584046:0:5815:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1790946357.585914:0:5815:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1790946357.585927:0:5815:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1790946357.586599:0:5815:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1790946357.586614:0:5815:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1790946357.588847:0:5815:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790946357.589051:0:5815:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1790946357.589058:0:5815:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1790946357.598966:0:5815:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1790946357.599087:0:5815:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1790946357.686065:0:5815:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790946357.686554:0:5815:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1790946357.686562:0:5815:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1790946357.688187:0:5815:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1790946357.688247:0:5815:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1790946357.692667:0:5815:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790946357.692874:0:5815:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1790946357.692881:0:5815:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1790946357.693717:0:5815:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1790946357.693727:0:5815:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1790946357.694274:0:5815:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790946357.694565:0:5815:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1790946357.694570:0:5815:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1790946357.698007:0:5815:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1790946357.698022:0:5815:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1790946357.702083:0:5815:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790946357.702316:0:5815:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1790946357.702323:0:5815:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1790946357.704706:0:5815:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1790946357.704717:0:5815:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1790946357.755389:0:5815:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790946357.757742:0:5815:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1790946357.757750:0:5815:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1790946357.767186:0:5815:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1790946357.767232:0:5815:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1790946357.769715:0:5815:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1790946357.769729:0:5815:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1790946357.771931:0:5815:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1790946357.771956:0:5815:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1790946357.771962:0:5815:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.113@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1790946357.772083:0:5815:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.113@tcp ctxt 0 is initialized 00000020:01000004:0.0:1790946357.772133:0:5815:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.113@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1790946357.772137:0:5815:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1790946357.772139:0:5815:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790946357.772140:0:5815:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790946357.772141:0:5815:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790946357.772142:0:5815:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790946357.772143:0:5815:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790946357.772144:0:5815:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790946357.772146:0:5815:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790946357.772152:0:5815:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790946357.772153:0:5815:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790946357.772154:0:5815:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790946357.772155:0:5815:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790946357.772157:0:5815:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1790946357.772160:0:5815:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790946357.772161:0:5815:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790946357.772162:0:5815:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790946357.772162:0:5815:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790946357.772163:0:5815:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790946357.772164:0:5815:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790946357.772165:0:5815:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790946357.772166:0:5815:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790946357.772167:0:5815:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790946357.772168:0:5815:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790946357.772169:0:5815:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790946357.772169:0:5815:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790946357.772230:0:5815:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1790946357.772247:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007bf53a8d pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5815:1877943303274752:0@lo:253: 00000100:00100000:0.0:1790946357.772328:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946357.772378:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a2273e84 going to sleep for 11 seconds 00000100:00100000:1.0:1790946357.774620:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303274752 00000100:00100000:1.0:1790946357.774634:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303274752 00000100:00100000:1.0:1790946357.774695:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790946357.774704:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000cf87a10e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+5:5815:x1877943303274752:12345-0@lo:253: 20000000:01000000:1.0:1790946357.774883:0:5829:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1790946357.774887:0:5829:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1790946357.776652:0:5850:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1790946357.776725:0:5829:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1790946357.777240:0:5829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790946357.780384:0:5851:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1790946357.781239:0:5829:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1790946357.781246:0:5829:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1790946357.781253:0:5829:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1790946357.781256:0:5829:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1790946357.781273:0:5829:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1790946357.781530:0:5829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790946357.782900:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1790946357.783036:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1790946357.783126:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1790946357.783470:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1790946357.783513:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1790946357.783826:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1790946357.783836:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1790946357.784010:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1790946357.784175:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1790946357.784373:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1790946357.784383:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1790946357.784413:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1790946357.784481:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1790946357.784639:0:5829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1790946357.784646:0:5829:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1790946357.784664:0:5829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790946357.786872:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1790946357.786904:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1790946357.786984:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1790946357.787022:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1790946357.787278:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1790946357.787299:0:5829:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1790946357.787536:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1790946357.787546:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1790946357.787687:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1790946357.787724:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1790946357.787870:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1790946357.787883:0:5829:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1790946357.787973:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1790946357.787981:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1790946357.788008:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1790946357.788149:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1790946357.788565:0:5829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1790946357.788617:0:5829:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1790946357.788626:0:5829:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1790946357.790496:0:5852:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1790946357.790872:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1790946357.790898:0:5829:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.113@tcp for mdt 20000000:01000000:2.0:1790946357.790901:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.113@tcp (null) (null) (null) 00000040:00080000:2.0:1790946357.790951:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1790946357.790960:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1790946357.791010:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1790946357.791018:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.113@tcp (null) (null) 00000040:00080000:2.0:1790946357.791065:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1790946357.791081:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1790946357.791126:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1790946357.791175:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1790946357.791288:0:5829:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1790946357.791291:0:5829:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1790946357.791299:0:5829:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1790946357.791312:0:5829:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1790946357.791316:0:5829:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1790946357.791343:0:5829:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1790946357.791345:0:5829:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1790946357.791954:0:5853:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1790946357.797917:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1790946357.797977:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1790946357.798014:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:1.0:1790946357.798032:0:5829:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1790946357.798035:0:5829:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1790946357.799731:0:5854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:1.0:1790946357.800821:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1790946357.800859:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:1.0:1790946357.800916:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:1.0:1790946357.800929:0:5829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790946357.800931:0:5829:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1790946357.800936:0:5829:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1790946357.800938:0:5829:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1790946357.800943:0:5829:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1790946357.800949:0:5829:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1790946357.801675:0:5855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1790946357.801846:0:5829:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1790946357.811865:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1790946357.811920:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1790946357.812017:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1790946357.812043:0:5829:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1790946357.812065:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000087470073/0x16e41aef93271987 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946357.812082:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000087470073/0x16e41aef93271987 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946357.812092:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000087470073/0x16e41aef93271987 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946357.812109:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000087470073/0x16e41aef93271987 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946357.812116:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000087470073/0x16e41aef93271987 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946357.812122:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000087470073/0x16e41aef93271987 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946357.812128:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000087470073 already unused, calling callback (000000004b1e7728) 00010000:00010000:1.0:1790946357.812131:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000087470073/0x16e41aef93271987 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946357.812138:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000087470073/0x16e41aef93271987 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946357.812151:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000087470073/0x16e41aef93271987 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946357.812158:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000087470073/0x16e41aef93271987 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946357.812172:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000087470073/0x16e41aef93271987 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790946357.812193:0:5829:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1790946358.024139:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000cf87a10e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+5:5815:x1877943303274752:12345-0@lo:253: Request processed in 249428us (251803us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946358.024156:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790946358.024355:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007bf53a8d pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5815:1877943303274752:0@lo:253: 10000000:01000000:0.0:1790946358.024372:0:5815:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1790946358.024388:0:5815:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790946358.024390:0:5815:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790946358.024391:0:5815:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790946358.024392:0:5815:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1790946358.024394:0:5815:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790946358.024395:0:5815:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790946358.024397:0:5815:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790946358.024398:0:5815:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790946358.024400:0:5815:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1790946358.024401:0:5815:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790946358.024402:0:5815:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1790946358.024422:0:5815:0:(tgt_mount.c:101:server_register_mount()) register mount 000000005e7f43b8 from lustre-MDT0000 10000000:01000000:0.0:1790946358.024450:0:5815:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1790946358.024454:0:5815:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1790946358.024458:0:5815:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff914682e5b380 10000000:01000000:0.0:1790946358.024463:0:5815:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790946358.024483:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff914682e5b380 from 1 10000000:01000000:0.0:1790946358.024486:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1790946358.024533:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 00000000c65f1ec9/0x16e41aef9327198e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946358.024544:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 00000000c65f1ec9/0x16e41aef9327198e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946358.024553:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 00000000c65f1ec9/0x16e41aef9327198e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946358.024574:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007bf53a8d pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5815:1877943303274880:0@lo:101: 00000100:00100000:0.0:1790946358.024614:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946358.024907:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303274880 00000100:00100000:2.0:1790946358.024915:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303274880 00000100:00100000:2.0:1790946358.024970:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790946358.024978:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000924b7f26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+5:5815:x1877943303274880:12345-0@lo:101: 00010000:00010000:2.0:1790946358.024991:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946358.025004:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009038f4ad/0x16e41aef93271995 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x16e41aef9327198e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946358.025025:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009038f4ad/0x16e41aef93271995 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x16e41aef9327198e expref: 6 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946358.025034:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009038f4ad/0x16e41aef93271995 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef9327198e expref: 6 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946358.025055:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009038f4ad, rc 0) 00000100:00100000:2.0:1790946358.025087:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000924b7f26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+6:5815:x1877943303274880:12345-0@lo:101: Request processed in 110us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946358.025093:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790946358.025661:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a894187f going to sleep for 11 seconds 00000100:00100000:0.0:1790946358.025695:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007bf53a8d pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5815:1877943303274880:0@lo:101: 00010000:00010000:0.0:1790946358.025714:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 00000000c65f1ec9/0x16e41aef9327198e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271995 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946358.025739:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 00000000c65f1ec9/0x16e41aef9327198e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93271995 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946358.025822:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007bf53a8d pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5815:1877943303275008:0@lo:501: 00000100:00100000:0.0:1790946358.025862:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946358.025892:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a894187f going to sleep for 11 seconds 00000100:00100000:2.0:1790946358.026232:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303275008 00000100:00100000:2.0:1790946358.026245:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303275008 00000100:00100000:2.0:1790946358.026278:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790946358.026285:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000001eb6d004 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+6:5815:x1877943303275008:12345-0@lo:501: 00000100:00100000:2.0:1790946358.026568:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000001eb6d004 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+6:5815:x1877943303275008:12345-0@lo:501: Request processed in 283us (705us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790946358.026578:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790946358.027441:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007bf53a8d pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5815:1877943303275008:0@lo:501: 10000000:01000000:0.0:1790946358.027661:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1790946358.027897:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 00000000c65f1ec9/0x16e41aef9327198e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271995 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946358.027908:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 00000000c65f1ec9/0x16e41aef9327198e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271995 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790946358.027918:0:5815:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9146aa748800 10000000:01000000:0.0:1790946358.027925:0:5815:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1790946358.027929:0:5815:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9146aa748800 10000000:01000000:0.0:1790946358.027932:0:5815:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1790946358.027935:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9146aa748800 from 1 10000000:01000000:0.0:1790946358.027937:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1790946358.027968:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 000000000f1d4bbf/0x16e41aef9327199c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946358.027975:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 000000000f1d4bbf/0x16e41aef9327199c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946358.027984:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 000000000f1d4bbf/0x16e41aef9327199c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946358.028021:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007bf53a8d pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5815:1877943303275136:0@lo:101: 00000100:00100000:0.0:1790946358.028192:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946358.028599:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303275136 00000100:00100000:2.0:1790946358.028607:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303275136 00000100:00100000:2.0:1790946358.028663:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790946358.028671:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000007fb8598e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+6:5815:x1877943303275136:12345-0@lo:101: 00000100:00100000:3.0:1790946358.028957:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a894187f going to sleep for 11 seconds 00010000:00010000:2.0:1790946358.029008:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946358.029024:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000074a6524a/0x16e41aef932719a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x16e41aef9327199c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946358.029125:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000074a6524a/0x16e41aef932719a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x16e41aef9327199c expref: 7 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946358.029138:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000074a6524a/0x16e41aef932719a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef9327199c expref: 7 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946358.029145:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000074a6524a, rc 0) 00000100:00100000:3.0:1790946358.029282:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007bf53a8d pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5815:1877943303275136:0@lo:101: 00010000:00010000:3.0:1790946358.029296:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 000000000f1d4bbf/0x16e41aef9327199c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef932719a3 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946358.029303:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 000000000f1d4bbf/0x16e41aef9327199c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef932719a3 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790946358.029328:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-barrier' succeeded (0). 00000100:00100000:2.0:1790946358.029417:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000007fb8598e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+7:5815:x1877943303275136:12345-0@lo:101: Request processed in 528us (1007us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946358.029426:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1790946358.029857:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 000000000f1d4bbf/0x16e41aef9327199c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef932719a3 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946358.029866:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 000000000f1d4bbf/0x16e41aef9327199c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef932719a3 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790946358.029890:0:5815:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1790946358.029894:0:5815:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790946358.029899:0:5815:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9146aa748800 10000000:01000000:3.0:1790946358.029901:0:5815:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1790946358.029905:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1790946358.029907:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1790946358.029941:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 000000000b0a99b5/0x16e41aef932719aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946358.029948:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 000000000b0a99b5/0x16e41aef932719aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946358.029955:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 000000000b0a99b5/0x16e41aef932719aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946358.029967:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bc4efd86 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5815:1877943303275264:0@lo:101: 00000100:00100000:3.0:1790946358.030003:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946358.030028:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b8cb454e going to sleep for 11 seconds 00000100:00100000:1.0:1790946358.030112:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303275264 00000100:00100000:1.0:1790946358.030119:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303275264 00000100:00100000:1.0:1790946358.030162:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790946358.030169:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000d06d0dd6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+7:5815:x1877943303275264:12345-0@lo:101: 00010000:00010000:1.0:1790946358.030179:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946358.030189:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000087470073/0x16e41aef932719b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x16e41aef932719aa expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946358.030231:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000087470073/0x16e41aef932719b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x16e41aef932719aa expref: 8 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946358.030240:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000087470073/0x16e41aef932719b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef932719aa expref: 8 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946358.030247:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000087470073, rc 0) 00000100:00100000:1.0:1790946358.030279:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000d06d0dd6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+8:5815:x1877943303275264:12345-0@lo:101: Request processed in 111us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946358.030284:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790946358.030464:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bc4efd86 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5815:1877943303275264:0@lo:101: 00010000:00010000:0.0:1790946358.030486:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 000000000b0a99b5/0x16e41aef932719aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef932719b1 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946358.030592:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 000000000b0a99b5/0x16e41aef932719aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef932719b1 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946358.030636:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000de283a1e pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5815:1877943303275392:0@lo:501: 00000100:00100000:0.0:1790946358.030656:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946358.030961:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303275392 00000100:00100000:2.0:1790946358.030967:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303275392 00000100:00100000:2.0:1790946358.030993:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790946358.030997:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000f0a53ace pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+8:5815:x1877943303275392:12345-0@lo:501: 00000100:00100000:0.0:1790946358.031139:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a894187f going to sleep for 11 seconds 00000100:00100000:0.0:1790946358.031711:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000de283a1e pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5815:1877943303275392:0@lo:501: 00000100:00100000:2.0:1790946358.031747:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000f0a53ace pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+9:5815:x1877943303275392:12345-0@lo:501: Request processed in 748us (1088us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946358.031911:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000de283a1e pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5815:1877943303275520:0@lo:503: 00000100:00100000:2.0:1790946358.031945:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790946358.032126:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946358.032238:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a894187f going to sleep for 11 seconds 00000100:00100000:3.0:1790946358.032482:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303275520 00000100:00100000:3.0:1790946358.032489:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303275520 00000100:00100000:3.0:1790946358.032778:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790946358.032788:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000003a3b4f43 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+9:5815:x1877943303275520:12345-0@lo:503: 00000100:00100000:3.0:1790946358.033060:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000003a3b4f43 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+9:5815:x1877943303275520:12345-0@lo:503: Request processed in 265us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946358.033067:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790946358.033376:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000de283a1e pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5815:1877943303275520:0@lo:503: 00000100:00100000:1.0:1790946358.034330:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cf1b7b13 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5858:1877943303275648:0@lo:502: 00000100:00100000:1.0:1790946358.034398:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946358.034450:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c4017837 going to sleep for 11 seconds 00000100:00100000:2.0:1790946358.034454:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303275648 00000100:00100000:2.0:1790946358.034461:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303275648 00000100:00100000:2.0:1790946358.034613:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790946358.034621:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000006cb71c34 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+9:5858:x1877943303275648:12345-0@lo:502: 00000100:00100000:2.0:1790946358.035012:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000006cb71c34 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+9:5858:x1877943303275648:12345-0@lo:502: Request processed in 392us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946358.035020:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790946358.035041:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cf1b7b13 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5858:1877943303275648:0@lo:502: 00000020:01000000:1.0:1790946358.035067:0:5858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790946358.035078:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790946358.035081:0:5858:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1790946358.035086:0:5858:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1790946358.035089:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790946358.035113:0:5858:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000e1bddb20) 00000020:00000080:1.0:1790946358.035129:0:5858:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1790946358.035135:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1790946358.035315:0:5858:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:1.0:1790946358.035323:0:5858:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x16e41aef932719bf 00000020:00000080:1.0:1790946358.035662:0:5858:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1790946358.035666:0:5858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790946358.035669:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790946358.035670:0:5858:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1790946358.035671:0:5858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790946358.035675:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790946358.035676:0:5858:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1790946358.035679:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790946358.035686:0:5858:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000d0dee1a5) 00000020:00000080:1.0:1790946358.035696:0:5858:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1790946358.035699:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1790946358.035701:0:5858:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1790946358.035704:0:5858:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1790946358.035709:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1790946358.035751:0:5858:0:(tgt_mount.c:153:server_get_mount()) get mount 000000005e7f43b8 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1790946358.035762:0:5858:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000b989b491) 00000020:00000080:1.0:1790946358.035770:0:5858:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1790946358.035818:0:5858:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1790946358.035823:0:5858:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x16e41aef932719d4 00000020:00000080:1.0:1790946358.035911:0:5858:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1790946358.035917:0:5858:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1790946358.035941:0:5858:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x16e41aef932719db 00080000:01000000:1.0:1790946358.035947:0:5858:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:1.0:1790946358.035950:0:5858:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x16e41aef932719e2 00080000:10000000:1.0:1790946358.036783:0:5858:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:1.0:1790946358.037054:0:5858:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1790946358.043653:0:5858:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:1.0:1790946358.116554:0:5858:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:1.0:1790946358.116861:0:5858:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1790946358.119462:0:5858:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1790946358.119742:0:5858:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1790946358.138587:0:5858:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000071474756) 00000020:00000080:0.0:1790946358.138609:0:5858:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1790946358.138685:0:5858:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:0.0:1790946358.138691:0:5858:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x16e41aef932719f0 00000020:00000080:1.0:1790946358.140158:0:5858:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1790946358.141407:0:5858:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1790946358.170639:0:5858:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1790946358.214616:0:5858:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1790946358.240037:0:5858:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1790946358.290030:0:5858:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1790946358.341433:0:5858:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:0.0:1790946358.378642:0:5858:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x16e41aef932719f7 00000020:00000080:0.0:1790946358.379114:0:5858:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1790946358.379125:0:5858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790946358.379136:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790946358.379139:0:5858:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1790946358.379142:0:5858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790946358.379147:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790946358.379148:0:5858:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790946358.379151:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790946358.379153:0:5858:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1790946358.379155:0:5858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790946358.379158:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790946358.379159:0:5858:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:0.0:1790946358.379161:0:5858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790946358.379166:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790946358.379167:0:5858:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1790946358.379171:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1790946358.379230:0:5858:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1790946358.379287:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000de283a1e pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5858:1877943303275776:0@lo:502: 00000100:00100000:0.0:1790946358.379371:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946358.379433:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set 000000007f6a85c6 going to sleep for 11 seconds 00000100:00100000:1.0:1790946358.379537:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303275776 00000100:00100000:1.0:1790946358.379545:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303275776 00000100:00100000:1.0:1790946358.379596:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790946358.379605:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000009737ebe8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+9:5858:x1877943303275776:12345-0@lo:502: 00000100:00100000:1.0:1790946358.380241:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000009737ebe8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+9:5858:x1877943303275776:12345-0@lo:502: Request processed in 636us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946358.380248:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790946358.380376:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000de283a1e pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5858:1877943303275776:0@lo:502: 00000020:01000000:0.0:1790946358.380407:0:5858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790946358.380413:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790946358.380415:0:5858:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1790946358.380419:0:5858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1790946358.380592:0:5815:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1790946358.380619:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1790946358.380671:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 000000000b0a99b5/0x16e41aef932719aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef932719b1 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946358.380682:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 000000000b0a99b5/0x16e41aef932719aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef932719b1 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790946358.380689:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9146aa748800 from 1 10000000:01000000:3.0:1790946358.380692:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790946358.380720:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 000000002ebdc405/0x16e41aef932719fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946358.380727:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 000000002ebdc405/0x16e41aef932719fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946358.380735:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 000000002ebdc405/0x16e41aef932719fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946358.380752:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bd735555 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5815:1877943303275904:0@lo:101: 00000100:00100000:3.0:1790946358.380860:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946358.380932:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b6ca1dac going to sleep for 11 seconds 00000100:00100000:2.0:1790946358.380994:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303275904 00000100:00100000:2.0:1790946358.381002:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303275904 00000100:00100000:2.0:1790946358.381066:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790946358.381074:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000006462def pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+9:5815:x1877943303275904:12345-0@lo:101: 00010000:00010000:2.0:1790946358.381085:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946358.381109:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001c9509e1/0x16e41aef93271a05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x16e41aef932719fe expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946358.381129:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001c9509e1/0x16e41aef93271a05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x16e41aef932719fe expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946358.381139:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001c9509e1/0x16e41aef93271a05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef932719fe expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946358.381148:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001c9509e1, rc 0) 00000100:00100000:2.0:1790946358.381255:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000006462def pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+10:5815:x1877943303275904:12345-0@lo:101: Request processed in 182us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946358.381272:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790946358.381425:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bd735555 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5815:1877943303275904:0@lo:101: 00010000:00010000:3.0:1790946358.381439:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 000000002ebdc405/0x16e41aef932719fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271a05 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946358.381448:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 000000002ebdc405/0x16e41aef932719fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93271a05 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946358.382025:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bd735555 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5815:1877943303276032:0@lo:256: 00000100:00100000:3.0:1790946358.382083:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946358.382165:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b6ca1dac going to sleep for 11 seconds 00000100:00100000:2.0:1790946358.382236:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303276032 00000100:00100000:2.0:1790946358.382241:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303276032 00000100:00100000:2.0:1790946358.382271:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790946358.382276:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000394e0364 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+10:5815:x1877943303276032:12345-0@lo:256: 20000000:01000000:2.0:1790946358.382292:0:5829:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1790946358.382298:0:5829:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1790946358.382368:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000394e0364 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+10:5815:x1877943303276032:12345-0@lo:256: Request processed in 92us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946358.382375:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790946358.382501:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bd735555 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5815:1877943303276032:0@lo:256: 10000000:01000000:3.0:1790946358.383020:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790946358.383034:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 000000002ebdc405/0x16e41aef932719fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271a05 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946358.383043:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 000000002ebdc405/0x16e41aef932719fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271a05 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790946358.383051:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9146aa748800 from 1 10000000:01000000:3.0:1790946358.383054:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790946358.383080:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 0000000046943837/0x16e41aef93271a0c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946358.383087:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 0000000046943837/0x16e41aef93271a0c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946358.383107:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 0000000046943837/0x16e41aef93271a0c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946358.383122:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bd735555 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5815:1877943303276160:0@lo:101: 00000100:00100000:3.0:1790946358.383156:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946358.383395:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b6ca1dac going to sleep for 11 seconds 00000100:00100000:0.0:1790946358.383459:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303276160 00000100:00100000:0.0:1790946358.383464:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303276160 00000100:00100000:0.0:1790946358.383507:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790946358.383515:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000bcd043dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+10:5815:x1877943303276160:12345-0@lo:101: 00010000:00010000:0.0:1790946358.383525:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946358.383539:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006541faf7/0x16e41aef93271a13 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x16e41aef93271a0c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946358.383573:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006541faf7/0x16e41aef93271a13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x16e41aef93271a0c expref: 11 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946358.383583:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006541faf7/0x16e41aef93271a13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93271a0c expref: 11 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946358.383590:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006541faf7, rc 0) 00000100:00100000:0.0:1790946358.383633:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000bcd043dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+11:5815:x1877943303276160:12345-0@lo:101: Request processed in 120us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946358.383639:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790946358.383714:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bd735555 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5815:1877943303276160:0@lo:101: 00010000:00010000:3.0:1790946358.383727:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 0000000046943837/0x16e41aef93271a0c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271a13 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946358.383734:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 0000000046943837/0x16e41aef93271a0c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93271a13 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946358.383802:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bd735555 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5815:1877943303276288:0@lo:501: 00000100:00100000:3.0:1790946358.383830:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946358.383851:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b6ca1dac going to sleep for 11 seconds 00000100:00100000:0.0:1790946358.383944:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303276288 00000100:00100000:0.0:1790946358.383949:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303276288 00000100:00100000:0.0:1790946358.383967:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790946358.383972:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000006b7ef2eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+11:5815:x1877943303276288:12345-0@lo:501: 00000100:00100000:0.0:1790946358.384590:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000006b7ef2eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+11:5815:x1877943303276288:12345-0@lo:501: Request processed in 618us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946358.384598:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790946358.384771:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bd735555 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5815:1877943303276288:0@lo:501: 00000100:00100000:3.0:1790946358.384805:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bd735555 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5815:1877943303276416:0@lo:503: 00000100:00100000:3.0:1790946358.384848:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946358.384878:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b6ca1dac going to sleep for 11 seconds 00000100:00100000:0.0:1790946358.384981:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303276416 00000100:00100000:0.0:1790946358.384987:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303276416 00000100:00100000:0.0:1790946358.385021:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790946358.385027:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000e86f26da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+11:5815:x1877943303276416:12345-0@lo:503: 00000040:00080000:0.0:1790946358.385064:0:5829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790946358.385119:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000e86f26da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+11:5815:x1877943303276416:12345-0@lo:503: Request processed in 92us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946358.385126:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790946358.385291:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bd735555 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5815:1877943303276416:0@lo:503: 00000040:00080000:3.0:1790946358.386187:0:5862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1790946358.386586:0:5815:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1790946358.386605:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790946358.386674:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 0000000046943837/0x16e41aef93271a0c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271a13 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946358.386687:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 0000000046943837/0x16e41aef93271a0c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271a13 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790946358.386733:0:5815:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1790946358.386736:0:5815:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9146aa748800 10000000:01000000:0.0:1790946358.386739:0:5815:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9146aa748800 10000000:01000000:0.0:1790946358.386743:0:5815:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790946358.386749:0:5815:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9146aa748800 from 1 10000000:01000000:0.0:1790946358.386751:0:5815:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790946358.386792:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 00000000d54e189a/0x16e41aef93271a1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946358.386801:0:5815:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 00000000d54e189a/0x16e41aef93271a1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946358.386810:0:5815:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 00000000d54e189a/0x16e41aef93271a1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946358.386828:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000de283a1e pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5815:1877943303276544:0@lo:101: 00000100:00100000:0.0:1790946358.386882:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946358.386921:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set 000000004cc0ba2b going to sleep for 11 seconds 00000100:00100000:1.0:1790946358.387038:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303276544 00000100:00100000:1.0:1790946358.387045:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303276544 00000100:00100000:1.0:1790946358.387087:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790946358.387106:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000cab6fc09 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+11:5815:x1877943303276544:12345-0@lo:101: 00010000:00010000:1.0:1790946358.387118:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946358.387128:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004357f1f7/0x16e41aef93271a21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x16e41aef93271a1a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946358.387149:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004357f1f7/0x16e41aef93271a21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x16e41aef93271a1a expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946358.387171:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004357f1f7/0x16e41aef93271a21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93271a1a expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946358.387179:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004357f1f7, rc 0) 00000100:00100000:1.0:1790946358.387248:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000cab6fc09 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+12:5815:x1877943303276544:12345-0@lo:101: Request processed in 154us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946358.387255:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790946358.387343:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000de283a1e pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5815:1877943303276544:0@lo:101: 00010000:00010000:3.0:1790946358.387357:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 00000000d54e189a/0x16e41aef93271a1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271a21 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946358.387365:0:5815:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 00000000d54e189a/0x16e41aef93271a1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93271a21 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946358.387411:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bd735555 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5815:1877943303276672:0@lo:501: 00000100:00100000:3.0:1790946358.387437:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946358.387462:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set 0000000093b06a1f going to sleep for 11 seconds 00000100:00100000:1.0:1790946358.387512:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303276672 00000100:00100000:1.0:1790946358.387517:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303276672 00000100:00100000:1.0:1790946358.387547:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790946358.387553:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000ec321609 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+12:5815:x1877943303276672:12345-0@lo:501: 00000100:00100000:1.0:1790946358.387799:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000ec321609 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+12:5815:x1877943303276672:12345-0@lo:501: Request processed in 246us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946358.387806:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790946358.387926:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bd735555 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5815:1877943303276672:0@lo:501: 00000100:00100000:3.0:1790946358.387952:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bd735555 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5815:1877943303276800:0@lo:503: 00000100:00100000:3.0:1790946358.387991:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946358.388020:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set 0000000093b06a1f going to sleep for 11 seconds 00000100:00100000:0.0:1790946358.388083:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303276800 00000100:00100000:0.0:1790946358.388088:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303276800 00000100:00100000:0.0:1790946358.388129:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790946358.388136:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000005fa552e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+12:5815:x1877943303276800:12345-0@lo:503: 00000100:00100000:0.0:1790946358.388465:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000005fa552e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+12:5815:x1877943303276800:12345-0@lo:503: Request processed in 330us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946358.388481:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790946358.388574:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bd735555 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5815:1877943303276800:0@lo:503: 00000100:00100000:3.0:1790946358.389141:0:5863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bd735555 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5863:1877943303276928:0@lo:502: 00000100:00100000:3.0:1790946358.389186:0:5863:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946358.389356:0:5863:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a2273e84 going to sleep for 11 seconds 00000100:00100000:0.0:1790946358.389417:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303276928 00000100:00100000:0.0:1790946358.389423:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303276928 00000100:00100000:0.0:1790946358.389461:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790946358.389468:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000676433e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+12:5863:x1877943303276928:12345-0@lo:502: 00000100:00100000:0.0:1790946358.389694:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000676433e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+12:5863:x1877943303276928:12345-0@lo:502: Request processed in 227us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946358.389702:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790946358.389791:0:5863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bd735555 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5863:1877943303276928:0@lo:502: 00000020:01000004:2.0:1790946358.389849:0:5863:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1790946358.389873:0:5863:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000008249fe39) 00000020:00000080:2.0:1790946358.389891:0:5863:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1790946358.389960:0:5863:0:(tgt_mount.c:153:server_get_mount()) get mount 000000005e7f43b8 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1790946358.389964:0:5863:0:(tgt_mount.c:187:server_put_mount()) put mount 000000005e7f43b8 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1790946358.389967:0:5863:0:(obd_mount.c:710:lustre_put_lsi()) put 000000005e7f43b8 4 00010000:00080000:2.0:1790946358.390004:0:5863:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000004b0a701@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.113@tcp at head 00010000:00010000:3.0:1790946358.393075:0:5863:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1790946358.393351:0:5863:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1790946358.393393:0:5863:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1790946358.393406:0:5863:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x16e41aef93271a2f 00000100:00080000:3.0:1790946358.393416:0:5863:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790946358.393426:0:5863:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000004b0a701 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:3.0:1790946358.393458:0:5863:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ae68a569 x1877943303277056/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790946358.393491:0:5863:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1790946358.396398:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ae68a569 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1877943303277056:0@lo:38: 00000100:00100000:1.0:1790946358.396479:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946358.396686:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303277056 00000100:00100000:2.0:1790946358.396696:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303277056 00000100:00100000:2.0:1790946358.396730:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790946358.396737:0:5863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ae708227 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5863:1877943303277184:0@lo:502: 00000100:00100000:2.0:1790946358.396738:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000cf1b7b13 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1877943303277056:12345-0@lo:38: 00000100:00100000:2.0:1790946358.396810:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000cf1b7b13 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1877943303277056:12345-0@lo:38: Request processed in 72us (330us total) trans 0 rc -11/-11 00000100:00100000:0.0:1790946358.396814:0:5863:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946358.396822:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790946358.396838:0:5863:0:(client.c:2716:ptlrpc_set_wait()) set 000000005ed358ef going to sleep for 11 seconds 00000100:00100000:2.0:1790946358.396869:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790946358.396876:0:3299:0:(import.c:65:import_set_state_nolock()) 0000000004b0a701 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790946358.396887:0:3299:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1790946358.396890:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ae68a569 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1877943303277056:0@lo:38: 00000100:00100000:1.0:1790946358.396962:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303277184 00000100:00100000:1.0:1790946358.396966:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303277184 00000100:00100000:1.0:1790946358.397001:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790946358.397007:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000d6919a95 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+12:5863:x1877943303277184:12345-0@lo:502: 00000100:00100000:1.0:1790946358.397270:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000d6919a95 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+12:5863:x1877943303277184:12345-0@lo:502: Request processed in 263us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946358.397278:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790946358.397309:0:5863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ae708227 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5863:1877943303277184:0@lo:502: 00000040:00080000:0.0:1790946358.397334:0:5863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1790946358.397609:0:5815:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1790946358.397627:0:5815:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790946358.397648:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 00000000d54e189a/0x16e41aef93271a1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271a21 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946358.397660:0:5815:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 00000000d54e189a/0x16e41aef93271a1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271a21 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1790946358.397721:0:5815:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1790946358.397724:0:5815:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790946358.397725:0:5815:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790946358.397726:0:5815:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790946358.397727:0:5815:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790946358.397729:0:5815:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790946358.397731:0:5815:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790946358.397732:0:5815:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790946358.397734:0:5815:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790946358.397735:0:5815:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790946358.397737:0:5815:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790946358.397738:0:5815:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790946358.397742:0:5815:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1790946358.397744:0:5815:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790946358.397745:0:5815:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790946358.397747:0:5815:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790946358.397748:0:5815:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790946358.397749:0:5815:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790946358.397750:0:5815:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790946358.397751:0:5815:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790946358.397751:0:5815:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790946358.397753:0:5815:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790946358.397754:0:5815:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790946358.397755:0:5815:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790946358.397756:0:5815:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790946358.397780:0:5815:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1790946358.397795:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001e4df5e3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5815:1877943303277312:0@lo:253: 00000100:00100000:2.0:1790946358.397828:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946358.397856:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set 0000000003f83ca9 going to sleep for 11 seconds 00000100:00100000:0.0:1790946358.399046:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303277312 00000100:00100000:0.0:1790946358.399057:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303277312 00000100:00100000:0.0:1790946358.399231:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790946358.399239:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000006f15f86a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+12:5815:x1877943303277312:12345-0@lo:253: 20000000:01000000:0.0:1790946358.399266:0:5829:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1790946358.399279:0:5829:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1790946358.427602:0:5829:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1790946358.427653:0:5829:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1790946358.429121:0:5850:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1790946358.429128:0:5850:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1790946358.429149:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000001841d622/0x16e41aef93271a36 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946358.429180:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000001c9509e1/0x16e41aef93271a05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef932719fe expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946358.429188:0:5850:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000001841d622/0x16e41aef93271a36 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946358.429246:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000001c9509e1/0x16e41aef93271a05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x16e41aef932719fe expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946358.429261:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000001c9509e1/0x16e41aef93271a05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x16e41aef932719fe expref: 12 pid: 5829 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946358.429276:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e5cf4b95 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5850:1877943303277440:0@lo:104: 00000100:00100000:1.0:1790946358.429460:0:5850:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946358.429570:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set 00000000da0a93a0 going to sleep for 11 seconds 00000100:00100000:2.0:1790946358.429834:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303277440 00000100:00100000:2.0:1790946358.429842:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303277440 00000100:00100000:2.0:1790946358.429921:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790946358.429931:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000e20940d2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+3:5850:x1877943303277440:12345-0@lo:104: 00010000:00010000:2.0:1790946358.429944:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: 000000002ebdc405/0x16e41aef932719fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93271a05 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946358.430016:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790946358.430022:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000e20940d2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+3:5850:x1877943303277440:12345-0@lo:104: Request processed in 94us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946358.430029:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1790946358.430074:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790946358.430081:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: 000000002ebdc405/0x16e41aef932719fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93271a05 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946358.430088:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002ebdc405 already unused, calling callback (000000009db54303) 10000000:00010000:0.0:1790946358.430091:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: 000000002ebdc405/0x16e41aef932719fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x16e41aef93271a05 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946358.430124:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: 000000002ebdc405/0x16e41aef932719fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x16e41aef93271a05 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790946358.430130:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: 000000002ebdc405/0x16e41aef932719fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x16e41aef93271a05 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790946358.430136:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790946358.430166:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: 000000002ebdc405/0x16e41aef932719fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271a05 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946358.430172:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790946358.430189:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: 000000002ebdc405/0x16e41aef932719fe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271a05 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946358.430195:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: 000000002ebdc405/0x16e41aef932719fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271a05 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946358.430230:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946358.430231:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946358.430233:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946358.430340:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ae708227 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3301:1877943303277568:0@lo:103: 00000100:00100000:0.0:1790946358.430372:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946358.430611:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e5cf4b95 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5850:1877943303277440:0@lo:104: 00010000:00010000:1.0:1790946358.430630:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000001841d622/0x16e41aef93271a36 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946358.430699:0:5819:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303277568 00000100:00100000:3.0:1790946358.430705:0:5819:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303277568 00010000:00010000:3.0:1790946358.430724:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000001c9509e1/0x16e41aef93271a05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef932719fe expref: 13 pid: 5829 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946358.430794:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790946358.430800:0:5819:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000084708834 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+13:3301:x1877943303277568:12345-0@lo:103: 00010000:00010000:3.0:1790946358.430812:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790946358.430817:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000001c9509e1/0x16e41aef93271a05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef932719fe expref: 13 pid: 5829 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946358.430826:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000001c9509e1/0x16e41aef93271a05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x16e41aef932719fe expref: 13 pid: 5829 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946358.430850:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001c9509e1/0x16e41aef93271a05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x16e41aef932719fe expref: 13 pid: 5829 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946358.430865:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000001841d622/0x16e41aef93271a36 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946358.430872:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001841d622/0x16e41aef93271a36 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790946358.430885:0:5819:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001757450s 00010000:00010000:3.0:1790946358.430888:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001841d622/0x16e41aef93271a36 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946358.430894:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001841d622/0x16e41aef93271a36 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946358.430899:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000001841d622/0x16e41aef93271a36 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946358.430904:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000001841d622/0x16e41aef93271a36 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946358.430910:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001841d622 already unused, calling callback (000000004b1e7728) 00010000:00010000:3.0:1790946358.430913:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000001841d622/0x16e41aef93271a36 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946358.430920:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000001841d622/0x16e41aef93271a36 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946358.430939:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000001841d622/0x16e41aef93271a36 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946358.430959:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790946358.430997:0:5819:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000084708834 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+12:3301:x1877943303277568:12345-0@lo:103: Request processed in 198us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946358.431004:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1790946358.431050:0:5850:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000001841d622/0x16e41aef93271a36 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946358.431057:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000001841d622/0x16e41aef93271a36 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946358.431063:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001841d622/0x16e41aef93271a36 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946358.432004:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ae708227 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3301:1877943303277568:0@lo:103: 00000100:00100000:3.0:1790946358.438379:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000006f15f86a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+11:5815:x1877943303277312:12345-0@lo:253: Request processed in 39134us (40543us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946358.438396:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790946358.438842:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001e4df5e3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5815:1877943303277312:0@lo:253: 10000000:01000000:2.0:1790946358.438857:0:5815:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1790946358.438860:0:5815:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790946358.438862:0:5815:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790946358.438864:0:5815:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790946358.438865:0:5815:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790946358.438866:0:5815:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790946358.438867:0:5815:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790946358.438869:0:5815:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790946358.438870:0:5815:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790946358.438872:0:5815:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790946358.438873:0:5815:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790946358.438875:0:5815:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790946358.438876:0:5815:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1790946358.438892:0:5815:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1790946358.444350:0:5815:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1790946358.444949:0:5815:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1790946358.445159:0:5815:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1790946358.445589:0:5815:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1790946358.445860:0:5815:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1790946358.446031:0:5815:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1790946358.446865:0:5815:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1790946358.447025:0:5815:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1790946358.447289:0:5815:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1790946358.447460:0:5815:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1790946358.447744:0:5815:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1790946358.447976:0:5815:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:3.0:1790946358.485832:0:5815:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1790946358.507856:0:5815:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1790946358.508035:0:5868:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1790946358.508039:0:5868:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1790946358.508128:0:5869:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1790946358.513074:0:5815:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1790946358.513414:0:5815:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1790946358.513899:0:5815:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1790946358.513904:0:5815:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1790946358.514028:0:5815:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790946358.516043:0:5815:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1790946358.520592:0:5815:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1790946358.520909:0:5815:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1790946358.521256:0:5815:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1790946358.521423:0:5815:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1790946358.522581:0:5815:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1790946358.522705:0:5815:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00010000:00010000:3.0:1790946358.526266:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1790946358.527021:0:5815:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1790946358.527421:0:5815:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1790946358.527553:0:5815:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1790946358.527677:0:5815:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1790946358.527901:0:5815:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1790946358.528028:0:5815:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1790946358.528671:0:5815:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1790946358.529443:0:5815:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1790946358.529596:0:5815:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1790946358.529733:0:5815:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1790946358.530632:0:5815:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1790946358.530772:0:5815:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1790946358.530920:0:5815:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1790946358.531052:0:5815:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1790946358.531446:0:5815:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1790946358.531570:0:5815:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1790946358.531704:0:5815:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1790946358.531827:0:5815:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1790946358.531960:0:5815:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1790946358.532079:0:5815:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1790946358.532599:0:5815:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1790946358.534873:0:5815:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1790946358.535066:0:5815:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1790946358.535539:0:5815:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1790946358.535684:0:5815:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1790946358.535829:0:5815:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1790946358.535975:0:5815:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1790946358.536108:0:5815:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1790946358.536767:0:5815:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1790946358.536928:0:5815:0:(lfsck_lib.c:2684:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1790946358.538161:0:5815:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1790946358.580432:0:5869:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1790946358.654581:0:5815:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1790946358.654631:0:5815:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa164c1cbf988 00100000:10000000:3.0:1790946358.654638:0:5815:0:(lfsck_lib.c:3084:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1790946358.654964:0:5815:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1790946358.654979:0:5815:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.113@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1790946358.654994:0:5815:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1790946358.655019:0:5815:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:1.0:1790946358.697400:0:5869:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1790946358.697474:0:5869:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1790946358.697479:0:5869:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1790946359.539012:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946360.563861:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946361.584346:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946362.613839:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790946363.164637:0:6112:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1790946363.633363:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790946363.888557:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1790946363.888569:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1790946363.888571:0:36:0:(import.c:65:import_set_state_nolock()) 0000000004b0a701 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790946363.888589:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000004b0a701 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:2.0:1790946363.888610:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e4ec637c x1877943303277824/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790946363.888646:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e4ec637c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1877943303277824:0@lo:38: 00000100:00100000:2.0:1790946363.888722:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946363.888817:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303277824 00000100:00100000:2.0:1790946363.888825:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303277824 00000100:00100000:1.0:1790946363.888828:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790946363.888840:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001e4df5e3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3303:1877943303277696:0@lo:400: 00000100:00100000:2.0:1790946363.888861:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790946363.888868:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000009ffda556 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3299:x1877943303277824:12345-0@lo:38: 00000100:00100000:1.0:1790946363.888883:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1790946363.888896:0:5836:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 148 last 0 00000100:00100000:1.0:1790946363.888915:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303277696 00000100:00100000:1.0:1790946363.888920:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303277696 00000020:00000080:2.0:1790946363.888945:0:5836:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x16e41aef93271a3d 00000100:00100000:1.0:1790946363.888958:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790946363.888966:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000c631a7f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+11:3303:x1877943303277696:12345-0@lo:400: 00000004:00100000:2.0:1790946363.888991:0:5836:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1790946363.889016:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000c631a7f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+11:3303:x1877943303277696:12345-0@lo:400: Request processed in 50us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946363.889489:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001e4df5e3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3303:1877943303277696:0@lo:400: 00000100:00080000:2.0:1790946363.889552:0:5836:0:(import.c:65:import_set_state_nolock()) 000000003628a50d : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790946363.889658:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000009ffda556 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1877943303277824:12345-0@lo:38: Request processed in 789us (937us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946363.889672:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790946363.890679:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1790946363.890906:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000e4ec637c x1877943303277824/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790946373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790946363.891185:0:3299:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1790946363.891195:0:3299:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1790946363.891217:0:3299:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1790946363.891220:0:3299:0:(import.c:65:import_set_state_nolock()) 0000000004b0a701 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1790946363.891227:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e4ec637c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1877943303277824:0@lo:38: 00010000:00010000:3.0:1790946364.657467:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790946365.424321:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790946365.424329:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9146aa748800 from 3 10000000:01000000:0.0:1790946365.424334:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790946365.424381:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 000000001979b2cc/0x16e41aef93271a44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946365.424394:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 000000001979b2cc/0x16e41aef93271a44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946365.424404:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 000000001979b2cc/0x16e41aef93271a44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946365.424429:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e067eb4d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303277952:0@lo:101: 00000100:00100000:0.0:1790946365.424504:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946365.424658:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 000000000b83473b going to sleep for 11 seconds 00000100:00100000:3.0:1790946365.425948:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303277952 00000100:00100000:3.0:1790946365.425968:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303277952 00000100:00100000:3.0:1790946365.426068:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790946365.426080:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000009b7c3673 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+11:5831:x1877943303277952:12345-0@lo:101: 00010000:00010000:3.0:1790946365.426110:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946365.426374:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005115528b/0x16e41aef93271a4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x16e41aef93271a44 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946365.426412:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005115528b/0x16e41aef93271a4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x16e41aef93271a44 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946365.426426:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005115528b/0x16e41aef93271a4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93271a44 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946365.426436:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005115528b, rc 0) 00000100:00100000:3.0:1790946365.426534:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000009b7c3673 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+12:5831:x1877943303277952:12345-0@lo:101: Request processed in 457us (2030us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946365.426542:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790946365.426686:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e067eb4d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303277952:0@lo:101: 00010000:00010000:0.0:1790946365.426713:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 000000001979b2cc/0x16e41aef93271a44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271a4b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946365.426726:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 000000001979b2cc/0x16e41aef93271a44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93271a4b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946365.426799:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e067eb4d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303278080:0@lo:256: 00000100:00100000:0.0:1790946365.426860:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946365.426910:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 000000000b83473b going to sleep for 11 seconds 00000100:00100000:2.0:1790946365.426945:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303278080 00000100:00100000:2.0:1790946365.426954:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303278080 00000100:00100000:2.0:1790946365.427001:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790946365.427009:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000564d6c9f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+12:5831:x1877943303278080:12345-0@lo:256: 20000000:01000000:2.0:1790946365.427030:0:5827:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790946365.427062:0:5827:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790946365.427066:0:5827:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1790946365.428126:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000564d6c9f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+12:5831:x1877943303278080:12345-0@lo:256: Request processed in 1114us (1261us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946365.428194:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e067eb4d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303278080:0@lo:256: 00000100:00100000:2.0:1790946365.428232:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 10000000:01000000:0.0:1790946365.428303:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790946365.428312:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 000000001979b2cc/0x16e41aef93271a44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271a4b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946365.428322:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 000000001979b2cc/0x16e41aef93271a44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271a4b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946365.684416:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946366.705371:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946367.728376:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1790946367.905472:0:6313:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeac205af0 20000000:00000080:3.0:1790946367.905488:0:6313:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9146b755fc00 uarg=0000000000000000 20000000:01000000:3.0:1790946367.905524:0:6313:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1790946367.905531:0:6313:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1790946367.905537:0:6313:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1790946367.906012:0:6313:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1790946367.906053:0:6313:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1790946367.909456:0:6313:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790946367.909734:0:6313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1790946367.909787:0:6313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1790946367.909835:0:6313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1790946367.909852:0:6313:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1790946367.909868:0:6313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000002ebdc405/0x16e41aef93271a52 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946367.909884:0:6313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000006541faf7/0x16e41aef93271a13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93271a0c expref: 11 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946367.909899:0:6313:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000002ebdc405/0x16e41aef93271a52 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946367.909933:0:6313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000006541faf7/0x16e41aef93271a13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x16e41aef93271a0c expref: 11 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946367.909948:0:6313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000006541faf7/0x16e41aef93271a13 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x16e41aef93271a0c expref: 11 pid: 5829 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946367.909963:0:6313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000014b1dc0e pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6313:1877943303278208:0@lo:104: 00000100:00100000:3.0:1790946367.911283:0:6313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946367.911525:0:6313:0:(client.c:2716:ptlrpc_set_wait()) set 0000000085d099a1 going to sleep for 11 seconds 00000100:00100000:2.0:1790946367.912001:0:5817:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303278208 00000100:00100000:2.0:1790946367.912010:0:5817:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303278208 00000100:00100000:2.0:1790946367.912075:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790946367.912084:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000a7b7c2b8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+3:6313:x1877943303278208:12345-0@lo:104: 00010000:00010000:2.0:1790946367.912106:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: 0000000046943837/0x16e41aef93271a0c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93271a13 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946367.912272:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790946367.912278:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000a7b7c2b8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+3:6313:x1877943303278208:12345-0@lo:104: Request processed in 195us (2254us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946367.912285:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1790946367.912307:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946367.912312:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: 0000000046943837/0x16e41aef93271a0c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93271a13 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946367.912335:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000046943837 already unused, calling callback (000000009db54303) 10000000:00010000:2.0:1790946367.912338:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: 0000000046943837/0x16e41aef93271a0c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x16e41aef93271a13 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946367.912345:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: 0000000046943837/0x16e41aef93271a0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x16e41aef93271a13 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790946367.912352:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: 0000000046943837/0x16e41aef93271a0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x16e41aef93271a13 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790946367.912356:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790946367.912389:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: 0000000046943837/0x16e41aef93271a0c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271a13 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946367.912396:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790946367.913319:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: 0000000046943837/0x16e41aef93271a0c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271a13 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946367.913329:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: 0000000046943837/0x16e41aef93271a0c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271a13 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946367.913351:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946367.913353:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946367.913355:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946367.913370:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c497b14e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3303:1877943303278336:0@lo:103: 00000100:00100000:2.0:1790946367.913418:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946367.913474:0:5820:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303278336 00000100:00100000:2.0:1790946367.913480:0:5820:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303278336 00010000:00010000:2.0:1790946367.913501:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000006541faf7/0x16e41aef93271a13 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef93271a0c expref: 12 pid: 5829 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946367.913533:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790946367.913539:0:5820:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000a1b76cca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+12:3303:x1877943303278336:12345-0@lo:103: 00010000:00010000:2.0:1790946367.913551:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790946367.913556:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000006541faf7/0x16e41aef93271a13 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef93271a0c expref: 12 pid: 5829 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946367.913565:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000006541faf7/0x16e41aef93271a13 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x16e41aef93271a0c expref: 12 pid: 5829 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946367.913582:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000002ebdc405/0x16e41aef93271a52 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946367.913589:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002ebdc405/0x16e41aef93271a52 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946367.913601:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002ebdc405/0x16e41aef93271a52 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946367.913606:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002ebdc405/0x16e41aef93271a52 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946367.913612:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000002ebdc405/0x16e41aef93271a52 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946367.913617:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000002ebdc405/0x16e41aef93271a52 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946367.913622:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002ebdc405 already unused, calling callback (000000004b1e7728) 00010000:00010000:2.0:1790946367.913625:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000002ebdc405/0x16e41aef93271a52 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946367.913639:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000002ebdc405/0x16e41aef93271a52 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946367.913647:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000002ebdc405/0x16e41aef93271a52 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946367.913656:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790946367.913853:0:5820:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000a1b76cca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+12:3303:x1877943303278336:12345-0@lo:103: Request processed in 150us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946367.913861:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790946367.913898:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c497b14e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3303:1877943303278336:0@lo:103: 00010000:00010000:1.0:1790946367.914522:0:6313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006541faf7/0x16e41aef93271a13 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x16e41aef93271a0c expref: 11 pid: 5829 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946367.914537:0:6313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000014b1dc0e pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6313:1877943303278208:0@lo:104: 00010000:00010000:1.0:1790946367.914553:0:6313:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000002ebdc405/0x16e41aef93271a52 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946367.914574:0:6313:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000002ebdc405/0x16e41aef93271a52 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946367.914580:0:6313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000002ebdc405/0x16e41aef93271a52 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946367.914586:0:6313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002ebdc405/0x16e41aef93271a52 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946368.752411:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946369.010917:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c700e6e8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1877943303278592:0@lo:400: 00000100:00100000:3.0:1790946369.010999:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946369.011040:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303278592 00000100:00100000:2.0:1790946369.011049:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303278592 00000100:00100000:3.0:1790946369.011073:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790946369.011079:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e24a1c4b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3301:1877943303278464:0@lo:400: 00000100:00100000:2.0:1790946369.011096:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790946369.011104:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000052bf1038 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1877943303278592:12345-0@lo:400: 00000100:00100000:3.0:1790946369.011110:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946369.011156:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000052bf1038 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1877943303278592:12345-0@lo:400: Request processed in 53us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946369.011163:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1790946369.011166:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000c700e6e8 x1877943303278592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946369.011181:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c700e6e8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1877943303278592:0@lo:400: 00000100:00100000:1.0:1790946369.015034:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303278464 00000100:00100000:1.0:1790946369.015053:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303278464 00000100:00100000:1.0:1790946369.016235:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790946369.016250:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@000000005c7a6f0e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+11:3301:x1877943303278464:12345-0@lo:400: 00000100:00100000:1.0:1790946369.016360:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@000000005c7a6f0e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+11:3301:x1877943303278464:12345-0@lo:400: Request processed in 114us (5248us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946369.016368:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790946369.017248:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e24a1c4b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3301:1877943303278464:0@lo:400: 00010000:00010000:2.0:1790946369.776892:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946370.801147:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1790946371.760303:0:5831:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790946371.760315:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9146aa748800 from 1 10000000:01000000:3.0:1790946371.760321:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790946371.760389:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 00000000c05707f1/0x16e41aef93271a59 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946371.760428:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 00000000c05707f1/0x16e41aef93271a59 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946371.760441:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 00000000c05707f1/0x16e41aef93271a59 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946371.760470:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c700e6e8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303278720:0@lo:101: 00000100:00100000:3.0:1790946371.760575:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946371.760656:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e5548d10 going to sleep for 11 seconds 00000100:00100000:2.0:1790946371.760891:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303278720 00000100:00100000:2.0:1790946371.760901:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303278720 00000100:00100000:2.0:1790946371.760966:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790946371.760975:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000fa6d4c03 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+11:5831:x1877943303278720:12345-0@lo:101: 00010000:00010000:2.0:1790946371.761002:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946371.761020:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001c9509e1/0x16e41aef93271a60 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x16e41aef93271a59 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946371.761060:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001c9509e1/0x16e41aef93271a60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x16e41aef93271a59 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946371.761072:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001c9509e1/0x16e41aef93271a60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93271a59 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946371.761083:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001c9509e1, rc 0) 00000100:00100000:2.0:1790946371.761137:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000fa6d4c03 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+12:5831:x1877943303278720:12345-0@lo:101: Request processed in 163us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946371.761144:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790946371.761256:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c700e6e8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303278720:0@lo:101: 00010000:00010000:1.0:1790946371.761276:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 00000000c05707f1/0x16e41aef93271a59 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271a60 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946371.761285:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 00000000c05707f1/0x16e41aef93271a59 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93271a60 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946371.761353:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e5cf4b95 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303278848:0@lo:501: 00000100:00100000:1.0:1790946371.761385:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946371.761410:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 000000003bc7916f going to sleep for 11 seconds 00000100:00100000:3.0:1790946371.761488:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303278848 00000100:00100000:3.0:1790946371.761493:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303278848 00000100:00100000:3.0:1790946371.761520:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790946371.761527:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000009c2f7d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+12:5831:x1877943303278848:12345-0@lo:501: 00000100:00100000:3.0:1790946371.762163:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000009c2f7d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+12:5831:x1877943303278848:12345-0@lo:501: Request processed in 634us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946371.762172:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790946371.763493:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e5cf4b95 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303278848:0@lo:501: 00000100:00100000:1.0:1790946371.763586:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e5cf4b95 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303278976:0@lo:503: 00000100:00100000:1.0:1790946371.764877:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946371.764954:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 000000003bc7916f going to sleep for 11 seconds 00000100:00100000:2.0:1790946371.765060:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303278976 00000100:00100000:2.0:1790946371.765072:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303278976 00000100:00100000:2.0:1790946371.765144:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790946371.765155:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@0000000002216068 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+12:5831:x1877943303278976:12345-0@lo:503: 00000100:00100000:2.0:1790946371.765596:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@0000000002216068 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+12:5831:x1877943303278976:12345-0@lo:503: Request processed in 442us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946371.765606:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790946371.765823:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e5cf4b95 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303278976:0@lo:503: 00000100:00100000:3.0:1790946371.766546:0:6542:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000be15ca76 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:6542:1877943303279104:0@lo:502: 00000100:00100000:3.0:1790946371.766613:0:6542:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946371.766731:0:6542:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c5fb3d5d going to sleep for 11 seconds 00000100:00100000:1.0:1790946371.766783:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303279104 00000100:00100000:1.0:1790946371.766792:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303279104 00000100:00100000:1.0:1790946371.766842:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790946371.766850:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@00000000fdcc964f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+12:6542:x1877943303279104:12345-0@lo:502: 00000100:00100000:1.0:1790946371.767133:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@00000000fdcc964f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+12:6542:x1877943303279104:12345-0@lo:502: Request processed in 284us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946371.767141:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790946371.768947:0:6542:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000be15ca76 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:6542:1877943303279104:0@lo:502: 00000020:01000000:3.0:1790946371.769019:0:6542:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790946371.769036:0:6542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790946371.769039:0:6542:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1790946371.769052:0:6542:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9146aa748800 00000020:00000080:3.0:1790946371.769054:0:6542:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1790946371.769146:0:6542:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914682eadc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:6542:1877943303279232:0@lo:502: 00000100:00100000:3.0:1790946371.769249:0:6542:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946371.769288:0:6542:0:(client.c:2716:ptlrpc_set_wait()) set ffff914698bef780 going to sleep for 11 seconds 00000100:00100000:1.0:1790946371.772245:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303279232 00000100:00100000:1.0:1790946371.772269:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303279232 00000100:00100000:1.0:1790946371.772340:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790946371.772351:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+12:6542:x1877943303279232:12345-0@lo:502: 00000100:00100000:1.0:1790946371.773710:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+12:6542:x1877943303279232:12345-0@lo:502: Request processed in 1351us (4451us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946371.773726:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1790946371.774336:0:6542:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914682eadc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:6542:1877943303279232:0@lo:502: 00000020:01000000:3.0:1790946371.774390:0:6542:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790946371.774403:0:6542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790946371.774406:0:6542:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1790946371.774412:0:6542:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1790946371.779127:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1790946371.779170:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790946371.779186:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146b1933200/0x16e41aef93271a59 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271a60 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946371.779215:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9146b1933200/0x16e41aef93271a59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271a60 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946371.824355:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946372.856271:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946373.872457:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946374.128483:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bdcc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877943303279488:0@lo:400: 00000100:00100000:0.0:1790946374.128555:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946374.128615:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790946374.128622:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bdcc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3303:1877943303279360:0@lo:400: 00000100:00100000:0.0:1790946374.128659:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946374.128698:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303279488 00000100:00100000:0.0:1790946374.128705:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303279488 00000100:00100000:0.0:1790946374.128743:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790946374.128751:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bdcc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877943303279488:12345-0@lo:400: 00000100:00100000:0.0:1790946374.128809:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bdcc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877943303279488:12345-0@lo:400: Request processed in 59us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946374.128818:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790946374.128840:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303279360 00000100:00100000:0.0:1790946374.128843:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303279360 00000100:00100000:0.0:1790946374.128867:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790946374.128873:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+12:3303:x1877943303279360:12345-0@lo:400: 00000100:00100000:0.0:1790946374.128901:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+12:3303:x1877943303279360:12345-0@lo:400: Request processed in 28us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946374.128907:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790946374.129154:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bdcc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3303:1877943303279360:0@lo:400: 00010000:00080000:0.0:1790946374.129167:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9146bdcc9f80 x1877943303279488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946374.129179:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bdcc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877943303279488:0@lo:400: 00000020:01000004:3.0:1790946374.430333:0:6671:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1790946374.430337:0:6671:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1790946374.430473:0:6671:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9146be38b800 00000020:01000004:3.0:1790946374.430490:0:6671:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1790946374.430503:0:6671:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1790946374.430517:0:6671:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff91469e0b8000) 00000020:00000080:3.0:1790946374.430532:0:6671:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1790946374.470483:0:6671:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1790946374.470748:0:6671:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1790946374.506103:0:6671:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1790946374.513084:0:6671:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1790946374.513120:0:6671:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1790946374.513325:0:6671:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1790946374.513358:0:6671:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1790946374.513852:0:6671:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1790946374.514062:0:6671:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790946374.514078:0:6671:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x16e41aef93271a6e 00000020:01000004:2.0:1790946374.514087:0:6671:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1790946374.514108:0:6671:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.113@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1790946374.514112:0:6671:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.113@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1790946374.514118:0:6671:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1790946374.514127:0:6671:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1790946374.514140:0:6671:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff914684fb3380) 00000020:00000080:2.0:1790946374.514157:0:6671:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1790946374.516409:0:6671:0:(service.c:173:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790946374.516596:0:6671:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1790946374.516603:0:6671:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1790946374.518535:0:6671:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1790946374.518544:0:6671:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1790946374.519035:0:6671:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1790946374.519042:0:6671:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1790946374.521060:0:6671:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790946374.521443:0:6671:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1790946374.521450:0:6671:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1790946374.528483:0:6671:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1790946374.528499:0:6671:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1790946374.559668:0:6671:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790946374.560058:0:6671:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1790946374.560066:0:6671:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1790946374.563551:0:6671:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1790946374.563566:0:6671:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1790946374.565384:0:6671:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1790946374.565413:0:6671:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1790946374.571680:0:6671:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790946374.572586:0:6671:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1790946374.572596:0:6671:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1790946374.574126:0:6671:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1790946374.574146:0:6671:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1790946374.635805:0:6671:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790946374.638330:0:6671:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1790946374.638342:0:6671:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1790946374.639413:0:6671:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1790946374.639422:0:6671:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1790946374.639876:0:6671:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1790946374.639900:0:6671:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1790946374.639906:0:6671:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.113@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1790946374.673187:0:6671:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.113@tcp ctxt 0 is initialized 00000020:01000004:3.0:1790946374.674048:0:6671:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.113@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1790946374.674053:0:6671:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1790946374.674054:0:6671:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790946374.674056:0:6671:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790946374.674057:0:6671:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790946374.674058:0:6671:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790946374.674059:0:6671:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790946374.674061:0:6671:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790946374.674062:0:6671:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790946374.674063:0:6671:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790946374.674065:0:6671:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790946374.674066:0:6671:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790946374.674069:0:6671:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1790946374.674075:0:6671:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790946374.674077:0:6671:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790946374.674078:0:6671:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790946374.674079:0:6671:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790946374.674080:0:6671:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790946374.674081:0:6671:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790946374.674082:0:6671:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790946374.674083:0:6671:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1790946374.674084:0:6671:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1790946374.674084:0:6671:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790946374.674085:0:6671:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790946374.674107:0:6671:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1790946374.674124:0:6671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914682eadc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:6671:1877943303279616:0@lo:253: 00000100:00100000:3.0:1790946374.674217:0:6671:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946374.674324:0:6671:0:(client.c:2716:ptlrpc_set_wait()) set ffff91468eb6e300 going to sleep for 11 seconds 00000100:00100000:1.0:1790946374.677479:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303279616 00000100:00100000:1.0:1790946374.677841:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303279616 00000100:00100000:1.0:1790946374.677966:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790946374.677987:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+12:6671:x1877943303279616:12345-0@lo:253: 20000000:01000000:1.0:1790946374.678028:0:5829:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1790946374.678059:0:5829:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1790946374.678065:0:5829:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1790946374.678069:0:5829:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1790946374.679573:0:5829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790946374.679761:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1790946374.679775:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1790946374.679814:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1790946374.679821:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1790946374.679850:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1790946374.679912:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1790946374.680360:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1790946374.680380:0:5829:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.113@tcp 20000000:01000000:1.0:1790946374.680382:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.113@tcp (null) (null) (null) 00000040:00080000:1.0:1790946374.680420:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1790946374.680426:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1790946374.680465:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1790946374.680471:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.113@tcp (null) (null) 00000040:00080000:1.0:1790946374.680497:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1790946374.680505:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1790946374.680528:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1790946374.680584:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1790946374.682697:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1790946374.682726:0:5829:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.113@tcp 20000000:01000000:1.0:1790946374.682728:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.113@tcp (null) (null) (null) 00000040:00080000:1.0:1790946374.682753:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1790946374.682758:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1790946374.682773:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1790946374.682777:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.113@tcp (null) (null) 00000040:00080000:1.0:1790946374.682802:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1790946374.682809:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1790946374.682825:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1790946374.682842:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1790946374.682859:0:5829:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1790946374.682861:0:5829:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1790946374.682863:0:5829:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1790946374.682926:0:5829:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1790946374.682928:0:5829:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1790946374.682954:0:5829:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1790946374.682955:0:5829:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1790946374.683652:0:6686:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1790946374.683705:0:6686:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1790946374.683751:0:6686:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1790946374.684108:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1790946374.684148:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1790946374.684178:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:1.0:1790946374.684189:0:5829:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1790946374.684191:0:5829:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1790946374.684834:0:6687:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1790946374.684965:0:6687:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1790946374.685034:0:6687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1790946374.685431:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1790946374.685470:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1790946374.685529:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1790946374.685544:0:5829:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1790946374.685546:0:5829:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1790946374.685972:0:6688:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1790946374.686189:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1790946374.686309:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1790946374.686380:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:2.0:1790946374.686396:0:5829:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1790946374.686399:0:5829:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1790946374.686407:0:5829:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1790946374.686426:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9146c20cb600/0x16e41aef93271a7c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946374.686444:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9146c20cae00/0x16e41aef93271995 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef9327198e expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946374.686452:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9146b180f800/0x16e41aef932719b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef932719aa expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946374.686458:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9146b180e600/0x16e41aef93271a21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93271a1a expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946374.686476:0:5829:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9146c20cb600/0x16e41aef93271a7c lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946374.686515:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9146b180e600/0x16e41aef93271a21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x16e41aef93271a1a expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946374.686530:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9146b180e600/0x16e41aef93271a21 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x16e41aef93271a1a expref: 12 pid: 5829 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946374.686545:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914685637480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5829:1877943303279744:0@lo:104: 00000100:00100000:2.0:1790946374.686611:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790946374.686728:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9146b180f800/0x16e41aef932719b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x16e41aef932719aa expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946374.686737:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9146b180f800/0x16e41aef932719b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x16e41aef932719aa expref: 12 pid: 5827 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946374.686745:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914685634a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5829:1877943303279872:0@lo:104: 00000100:00100000:2.0:1790946374.686766:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790946374.686843:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9146c20cae00/0x16e41aef93271995 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x16e41aef9327198e expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946374.686851:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9146c20cae00/0x16e41aef93271995 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x16e41aef9327198e expref: 12 pid: 5828 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946374.686859:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914685636680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5829:1877943303280000:0@lo:104: 00000100:00100000:2.0:1790946374.686892:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946374.687368:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303279744 00000100:00100000:3.0:1790946374.687375:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303279744 00000100:00100000:3.0:1790946374.687411:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303279872 00000100:00100000:3.0:1790946374.687414:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303279872 00000100:00100000:3.0:1790946374.687429:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790946374.687438:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914685635f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+4:5829:x1877943303279744:12345-0@lo:104: 00010000:00010000:3.0:1790946374.687452:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff914680031e00/0x16e41aef93271a1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93271a21 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946374.687540:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790946374.687547:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914685635f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+4:5829:x1877943303279744:12345-0@lo:104: Request processed in 111us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946374.687554:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790946374.687572:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790946374.687584:0:5817:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914685637800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+3:5829:x1877943303279872:12345-0@lo:104: 00010000:00010000:0.0:1790946374.687595:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9146b1933800/0x16e41aef932719aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef932719b1 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946374.687686:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146867d1300 going to sleep for 11 seconds 00000100:00100000:2.0:1790946374.687705:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914685637480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5829:1877943303279744:0@lo:104: 00000100:00100000:2.0:1790946374.687725:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914685634a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5829:1877943303279872:0@lo:104: 00000100:00100000:3.0:1790946374.687834:0:5818:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1790946374.687841:0:5818:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:2.0:1790946374.688098:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303280000 00000100:00100000:2.0:1790946374.688103:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303280000 00000100:00100000:3.0:1790946374.688254:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790946374.688261:0:6689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914685636d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+4:5829:x1877943303280000:12345-0@lo:104: 00010000:00010000:3.0:1790946374.688278:0:6689:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff914680030c00/0x16e41aef9327198e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93271995 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946374.688352:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1790946374.688359:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff914680031e00/0x16e41aef93271a1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93271a21 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946374.688367:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914680031e00 already unused, calling callback (ffffffffc1d96c20) 10000000:00010000:1.0:1790946374.688370:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff914680031e00/0x16e41aef93271a1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x16e41aef93271a21 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946374.688378:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff914680031e00/0x16e41aef93271a1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x16e41aef93271a21 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790946374.688385:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff914680031e00/0x16e41aef93271a1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x16e41aef93271a21 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790946374.688391:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790946374.688425:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff914680031e00/0x16e41aef93271a1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271a21 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946374.688438:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790946374.688456:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff914680031e00/0x16e41aef93271a1a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271a21 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946374.688463:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff914680031e00/0x16e41aef93271a1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271a21 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946374.688477:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790946374.688481:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9146b1933800/0x16e41aef932719aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef932719b1 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946374.688486:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1933800 already unused, calling callback (ffffffffc1d96c20) 10000000:00010000:1.0:1790946374.688489:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9146b1933800/0x16e41aef932719aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x16e41aef932719b1 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946374.688496:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9146b1933800/0x16e41aef932719aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x16e41aef932719b1 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790946374.688502:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9146b1933800/0x16e41aef932719aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x16e41aef932719b1 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790946374.688507:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790946374.688520:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9146b1933800/0x16e41aef932719aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef932719b1 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946374.688526:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790946374.688530:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9146b1933800/0x16e41aef932719aa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef932719b1 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946374.688536:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9146b1933800/0x16e41aef932719aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef932719b1 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946374.688551:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790946374.688554:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff914680030c00/0x16e41aef9327198e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93271995 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946374.688560:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914680030c00 already unused, calling callback (ffffffffc1d96c20) 10000000:00010000:1.0:1790946374.688563:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff914680030c00/0x16e41aef9327198e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x16e41aef93271995 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946374.688570:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff914680030c00/0x16e41aef9327198e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x16e41aef93271995 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790946374.688575:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff914680030c00/0x16e41aef9327198e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x16e41aef93271995 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790946374.688579:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790946374.688592:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff914680030c00/0x16e41aef9327198e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271995 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946374.688597:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790946374.688611:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff914680030c00/0x16e41aef9327198e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271995 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946374.688618:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff914680030c00/0x16e41aef9327198e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271995 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946374.688632:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946374.688634:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946374.688635:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946374.688654:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b68a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3300:1877943303280128:0@lo:103: 00000100:00100000:1.0:1790946374.688691:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946374.688716:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790946374.688721:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b68aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3300:1877943303280256:0@lo:103: 00000100:00100000:1.0:1790946374.688740:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946374.688767:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b68a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3302:1877943303280384:0@lo:103: 00000100:00100000:1.0:1790946374.688787:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946374.688821:0:5820:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303280128 00000100:00100000:1.0:1790946374.688825:0:5820:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303280128 00010000:00010000:1.0:1790946374.688848:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9146b180e600/0x16e41aef93271a21 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef93271a1a expref: 13 pid: 5829 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946374.688861:0:5820:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303280256 00000100:00100000:1.0:1790946374.688864:0:5820:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303280256 00000100:00100000:2.0:1790946374.689011:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914685636680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5829:1877943303280000:0@lo:104: 00010000:00010000:2.0:1790946374.689036:0:5829:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9146c20cb600/0x16e41aef93271a7c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946374.689080:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9146b180f800/0x16e41aef932719b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef932719aa expref: 14 pid: 5827 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946374.689092:0:5820:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303280384 00000100:00100000:1.0:1790946374.689095:0:5820:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303280384 00010000:00010000:1.0:1790946374.689106:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9146c20cae00/0x16e41aef93271995 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef9327198e expref: 15 pid: 5828 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946374.689119:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790946374.689125:0:5820:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b68a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+15:3300:x1877943303280128:12345-0@lo:103: 00010000:00010000:1.0:1790946374.689135:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790946374.689141:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9146b180e600/0x16e41aef93271a21 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef93271a1a expref: 15 pid: 5829 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946374.689150:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9146b180e600/0x16e41aef93271a21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x16e41aef93271a1a expref: 15 pid: 5829 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946374.689173:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9146b180e600/0x16e41aef93271a21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x16e41aef93271a1a expref: 15 pid: 5829 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946374.689186:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790946374.689245:0:5820:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b68a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+14:3300:x1877943303280128:12345-0@lo:103: Request processed in 120us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946374.689252:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790946374.689270:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790946374.689275:0:5820:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b68ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+13:3300:x1877943303280256:12345-0@lo:103: 00010000:00010000:1.0:1790946374.689282:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790946374.689286:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9146b180f800/0x16e41aef932719b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef932719aa expref: 13 pid: 5827 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946374.689293:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9146b180f800/0x16e41aef932719b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x16e41aef932719aa expref: 13 pid: 5827 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946374.689302:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9146b180f800/0x16e41aef932719b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x16e41aef932719aa expref: 13 pid: 5827 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946374.689311:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790946374.689331:0:5820:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b68ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+12:3300:x1877943303280256:12345-0@lo:103: Request processed in 56us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946374.689336:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790946374.689348:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790946374.689353:0:5820:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b68a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+11:3302:x1877943303280384:12345-0@lo:103: 00010000:00010000:1.0:1790946374.689360:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790946374.689365:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9146c20cae00/0x16e41aef93271995 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef9327198e expref: 11 pid: 5828 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946374.689378:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9146c20cae00/0x16e41aef93271995 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x16e41aef9327198e expref: 11 pid: 5828 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946374.689387:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9146c20cae00/0x16e41aef93271995 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x16e41aef9327198e expref: 11 pid: 5828 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946374.689399:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9146c20cb600/0x16e41aef93271a7c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946374.689407:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9146c20cb600/0x16e41aef93271a7c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946374.689420:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9146c20cb600/0x16e41aef93271a7c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946374.689426:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9146c20cb600/0x16e41aef93271a7c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946374.689433:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9146c20cb600/0x16e41aef93271a7c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946374.689440:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9146c20cb600/0x16e41aef93271a7c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946374.689445:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146c20cb600 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:1.0:1790946374.689448:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9146c20cb600/0x16e41aef93271a7c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946374.689456:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9146c20cb600/0x16e41aef93271a7c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946374.689481:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9146c20cb600/0x16e41aef93271a7c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946374.689491:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790946374.689520:0:5820:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b68a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+10:3302:x1877943303280384:12345-0@lo:103: Request processed in 166us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946374.689527:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790946374.689562:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b68a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3302:1877943303280384:0@lo:103: 00010000:00010000:1.0:1790946374.689579:0:5829:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9146c20cb600/0x16e41aef93271a7c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946374.689586:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9146c20cb600/0x16e41aef93271a7c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946374.689593:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9146c20cb600/0x16e41aef93271a7c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790946374.689605:0:5829:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1790946374.690003:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b68aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3300:1877943303280256:0@lo:103: 00000100:00100000:2.0:1790946374.690011:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b68a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3300:1877943303280128:0@lo:103: 00010000:00010000:0.0:1790946374.690171:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00010000:00010000:3.0:1790946374.690179:0:6689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1790946374.690182:0:5817:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914685637800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+4:5829:x1877943303279872:12345-0@lo:104: Request processed in 2599us (3412us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946374.690190:0:6689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914685636d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+4:5829:x1877943303280000:12345-0@lo:104: Request processed in 1927us (3296us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946374.690197:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790946374.690421:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1790946374.690561:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946374.692046:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946374.794593:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+9:6671:x1877943303279616:12345-0@lo:253: Request processed in 116608us (120382us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946374.794609:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790946374.795530:0:6671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914682eadc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:6671:1877943303279616:0@lo:253: 10000000:01000000:2.0:1790946374.795547:0:6671:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1790946374.795551:0:6671:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790946374.795553:0:6671:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790946374.795555:0:6671:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790946374.795556:0:6671:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1790946374.795557:0:6671:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790946374.795559:0:6671:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790946374.795560:0:6671:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790946374.795562:0:6671:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1790946374.795564:0:6671:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790946374.795565:0:6671:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1790946374.795589:0:6671:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9146be38b800 from lustre-OST0000 10000000:01000000:2.0:1790946374.795619:0:6671:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1790946374.795622:0:6671:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1790946374.795628:0:6671:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff914682e5b380 local copy 10000000:01000000:2.0:1790946374.795632:0:6671:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1790946374.795682:0:6671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146c20cb600/0x16e41aef93271a83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946374.795694:0:6671:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.113@tcp lock: ffff9146c20cb600/0x16e41aef93271a83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946374.795718:0:6671:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9146c20cb600/0x16e41aef93271a83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946374.795737:0:6671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914685636680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:6671:1877943303280512:0@lo:101: 00000100:00100000:2.0:1790946374.795855:0:6671:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946374.795984:0:6671:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146867d1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790946374.796528:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303280512 00000100:00100000:0.0:1790946374.796551:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303280512 00000100:00100000:0.0:1790946374.796652:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790946374.796661:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+9:6671:x1877943303280512:12345-0@lo:101: 00010000:00010000:0.0:1790946374.796675:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946374.796692:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff914680030000/0x16e41aef93271a8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x16e41aef93271a83 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946374.796719:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff914680030000/0x16e41aef93271a8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x16e41aef93271a83 expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946374.796730:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff914680030000/0x16e41aef93271a8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93271a83 expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946374.796739:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914680030000, rc 0) 00000100:00100000:0.0:1790946374.796810:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+10:6671:x1877943303280512:12345-0@lo:101: Request processed in 150us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946374.796816:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790946374.796902:0:6671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914685636680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:6671:1877943303280512:0@lo:101: 00010000:00010000:3.0:1790946374.796918:0:6671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9146c20cb600/0x16e41aef93271a83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x16e41aef93271a8a expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946374.796926:0:6671:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9146c20cb600/0x16e41aef93271a83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x16e41aef93271a8a expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946374.797042:0:6671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914682eac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:6671:1877943303280640:0@lo:501: 00000100:00100000:3.0:1790946374.797075:0:6671:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946374.801116:0:6671:0:(client.c:2716:ptlrpc_set_wait()) set ffff914698bb6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790946374.801116:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303280640 00000100:00100000:2.0:1790946374.801130:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303280640 00000100:00100000:2.0:1790946374.801186:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790946374.801195:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+10:6671:x1877943303280640:12345-0@lo:501: 00000100:00100000:2.0:1790946374.803713:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+10:6671:x1877943303280640:12345-0@lo:501: Request processed in 2510us (6627us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790946374.803731:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790946374.804254:0:6671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914682eac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:6671:1877943303280640:0@lo:501: 10000000:01000000:3.0:1790946374.804278:0:6671:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.113@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1790946374.804326:0:6671:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.113@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1790946374.804335:0:6671:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146c20cb600/0x16e41aef93271a83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x16e41aef93271a8a expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946374.804345:0:6671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146c20cb600/0x16e41aef93271a83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x16e41aef93271a8a expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946374.804353:0:6671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff9146c20cb600/0x16e41aef93271a83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x16e41aef93271a8a expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946374.804385:0:6671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1790946374.804406:0:6671:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9146be38b800 10000000:01000000:3.0:1790946374.804412:0:6671:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1790946374.804416:0:6671:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff914682e5b380 10000000:01000000:3.0:1790946374.804419:0:6671:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1790946374.804422:0:6671:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff914682e5b380 from 1 10000000:01000000:3.0:1790946374.804425:0:6671:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1790946374.804457:0:6671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146b1932a00/0x16e41aef93271a91 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946374.804466:0:6671:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9146b1932a00/0x16e41aef93271a91 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946374.804477:0:6671:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9146b1932a00/0x16e41aef93271a91 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946374.804495:0:6671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914682eac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:6671:1877943303280768:0@lo:101: 00000100:00100000:3.0:1790946374.804540:0:6671:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946374.804572:0:6671:0:(client.c:2716:ptlrpc_set_wait()) set ffff914698bb6780 going to sleep for 11 seconds 00010000:00010000:2.0:1790946374.804902:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946374.804909:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9146c20cb600/0x16e41aef93271a83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x16e41aef93271a8a expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946374.804917:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146c20cb600 already unused, calling callback (ffffffffc1d96c20) 10000000:00010000:2.0:1790946374.804921:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9146c20cb600/0x16e41aef93271a83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x16e41aef93271a8a expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946374.804930:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9146c20cb600/0x16e41aef93271a83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x16e41aef93271a8a expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790946374.805016:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9146c20cb600/0x16e41aef93271a83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x16e41aef93271a8a expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790946374.805022:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790946374.805056:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9146c20cb600/0x16e41aef93271a83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x16e41aef93271a8a expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946374.805063:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790946374.805098:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9146c20cb600/0x16e41aef93271a83 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x16e41aef93271a8a expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946374.805107:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9146c20cb600/0x16e41aef93271a83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x16e41aef93271a8a expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946374.805128:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946374.805129:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946374.805131:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946374.805146:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303280768 00000100:00100000:2.0:1790946374.805152:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303280768 00000100:00100000:2.0:1790946374.805186:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790946374.805194:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+10:6671:x1877943303280768:12345-0@lo:101: 00010000:00010000:2.0:1790946374.805249:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946374.805265:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9146c20cae00/0x16e41aef93271a98 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x16e41aef93271a91 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946374.805383:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914685634a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3303:1877943303280896:0@lo:103: 00000100:00100000:3.0:1790946374.805426:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790946374.805487:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9146c20cae00/0x16e41aef93271a98 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x16e41aef93271a91 expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946374.805501:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9146c20cae00/0x16e41aef93271a98 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93271a91 expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946374.805513:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146c20cae00, rc 0) 00000100:00100000:2.0:1790946374.805556:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+11:6671:x1877943303280768:12345-0@lo:101: Request processed in 361us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946374.805562:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790946374.805714:0:6671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914682eac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:6671:1877943303280768:0@lo:101: 00010000:00010000:3.0:1790946374.805729:0:6671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9146b1932a00/0x16e41aef93271a91 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271a98 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946374.805737:0:6671:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9146b1932a00/0x16e41aef93271a91 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93271a98 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790946374.805764:0:6671:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1790946374.805877:0:6671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146b1932a00/0x16e41aef93271a91 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271a98 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946374.805886:0:6671:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9146b1932a00/0x16e41aef93271a91 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271a98 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790946374.805893:0:6671:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1790946374.805898:0:6671:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790946374.805902:0:6671:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1790946374.805904:0:6671:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1790946374.805921:0:6671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146b1933400/0x16e41aef93271a9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946374.805927:0:6671:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9146b1933400/0x16e41aef93271a9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946374.805946:0:6671:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9146b1933400/0x16e41aef93271a9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946374.805961:0:6671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914682eac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:6671:1877943303281024:0@lo:101: 00000100:00100000:3.0:1790946374.805999:0:6671:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946374.806014:0:6671:0:(client.c:2716:ptlrpc_set_wait()) set ffff914698bb6780 going to sleep for 11 seconds 00000100:00100000:0.0:1790946374.806146:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303281024 00000100:00100000:0.0:1790946374.806152:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303281024 00000100:00100000:0.0:1790946374.806187:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790946374.806189:0:5820:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303280896 00000100:00100000:0.0:1790946374.806195:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+11:6671:x1877943303281024:12345-0@lo:101: 00000100:00100000:1.0:1790946374.806196:0:5820:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303280896 00010000:00010000:0.0:1790946374.806225:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946374.806237:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff914680031a00/0x16e41aef93271aa6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x16e41aef93271a9f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946374.806256:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1790946374.806267:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff914680031a00/0x16e41aef93271aa6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x16e41aef93271a9f expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946374.806268:0:5820:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682eaf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+13:3303:x1877943303280896:12345-0@lo:103: 00010000:00010000:0.0:1790946374.806283:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff914680031a00/0x16e41aef93271aa6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93271a9f expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946374.806285:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790946374.806300:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff914680030000/0x16e41aef93271a8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x16e41aef93271a83 expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946374.806306:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914680031a00, rc 0) 00010000:00010000:1.0:1790946374.806323:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790946374.806342:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+12:6671:x1877943303281024:12345-0@lo:101: Request processed in 148us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946374.806349:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790946374.806369:0:5820:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682eaf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+11:3303:x1877943303280896:12345-0@lo:103: Request processed in 104us (941us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946374.806378:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790946374.806486:0:6671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914682eac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:6671:1877943303281024:0@lo:101: 00010000:00010000:3.0:1790946374.806498:0:6671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9146b1933400/0x16e41aef93271a9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271aa6 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946374.806506:0:6671:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9146b1933400/0x16e41aef93271a9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93271aa6 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946374.806522:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914685634a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3303:1877943303280896:0@lo:103: 00000100:00100000:3.0:1790946374.806600:0:6671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914682eac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:6671:1877943303281152:0@lo:501: 00000100:00100000:3.0:1790946374.806628:0:6671:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946374.806664:0:6671:0:(client.c:2716:ptlrpc_set_wait()) set ffff914698bb6780 going to sleep for 11 seconds 00000100:00100000:3.0:1790946374.806679:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303281152 00000100:00100000:3.0:1790946374.806683:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303281152 00000100:00100000:3.0:1790946374.806714:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790946374.806721:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+11:6671:x1877943303281152:12345-0@lo:501: 00000100:00100000:3.0:1790946374.807197:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+11:6671:x1877943303281152:12345-0@lo:501: Request processed in 475us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946374.807232:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790946374.807378:0:6671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914682eac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:6671:1877943303281152:0@lo:501: 00000100:00100000:0.0:1790946374.807410:0:6671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bdcc9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:6671:1877943303281280:0@lo:503: 00000100:00100000:0.0:1790946374.807451:0:6671:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946374.807484:0:6671:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146a035fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1790946374.807541:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303281280 00000100:00100000:1.0:1790946374.807546:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303281280 00000100:00100000:1.0:1790946374.807581:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1790946374.807588:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+11:6671:x1877943303281280:12345-0@lo:503: 00000100:00100000:1.0:1790946374.807954:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+11:6671:x1877943303281280:12345-0@lo:503: Request processed in 365us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946374.807962:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790946374.808119:0:6671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bdcc9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:6671:1877943303281280:0@lo:503: 00000040:00080000:0.0:1790946374.808609:0:6671:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790946374.809390:0:6671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bdcc9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:6671:1877943303281408:0@lo:502: 00000100:00100000:0.0:1790946374.809459:0:6671:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946374.809544:0:6671:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146a035fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1790946374.809595:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303281408 00000100:00100000:3.0:1790946374.809603:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303281408 00000100:00100000:3.0:1790946374.809777:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790946374.809786:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+11:6671:x1877943303281408:12345-0@lo:502: 00000100:00100000:3.0:1790946374.810187:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+11:6671:x1877943303281408:12345-0@lo:502: Request processed in 400us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946374.810195:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790946374.813274:0:6671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bdcc9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:6671:1877943303281408:0@lo:502: 00000040:00080000:0.0:1790946374.814139:0:6671:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1790946374.814236:0:6671:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1790946374.814275:0:6671:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1790946374.814328:0:6671:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1790946374.814363:0:6671:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1790946374.814395:0:6671:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1790946374.814450:0:6671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bdcc9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:6671:1877943303281536:0@lo:502: 00000100:00100000:0.0:1790946374.814552:0:6671:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946374.814599:0:6671:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146a035fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1790946374.814615:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303281536 00000100:00100000:1.0:1790946374.814624:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303281536 00000100:00100000:1.0:1790946374.814687:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1790946374.814697:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+11:6671:x1877943303281536:12345-0@lo:502: 00000100:00100000:1.0:1790946374.814897:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+11:6671:x1877943303281536:12345-0@lo:502: Request processed in 202us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946374.814905:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790946374.815156:0:6671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bdcc9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:6671:1877943303281536:0@lo:502: 00000040:00080000:0.0:1790946374.815280:0:6671:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1790946374.815298:0:6671:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:0.0:1790946374.817840:0:6691:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790946374.817852:0:6691:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1790946374.817859:0:6691:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790946374.817862:0:6691:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1790946374.817867:0:6691:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790946374.817884:0:6691:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9146849d99c0) 00000020:00000080:0.0:1790946374.817923:0:6691:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:0.0:1790946374.820236:0:6691:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1790946374.820344:0:6691:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9146be38b800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1790946374.820353:0:6691:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1790946374.820363:0:6691:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x16e41aef93271ab4 00010000:00010000:1.0:1790946374.833375:0:6691:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:1.0:1790946374.835379:0:6691:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1790946374.844406:0:6691:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1790946374.844910:0:6691:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1790946374.854861:0:6691:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1790946374.856093:0:6691:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1790946374.866513:0:6691:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1790946374.866528:0:6691:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790946374.866536:0:6691:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790946374.866538:0:6691:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1790946374.866542:0:6691:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790946374.866546:0:6691:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790946374.866547:0:6691:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790946374.866551:0:6691:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790946374.866552:0:6691:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1790946374.866603:0:6691:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790946374.866612:0:6691:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790946374.866614:0:6691:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:3.0:1790946374.866617:0:6691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1790946374.866762:0:6671:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1790946374.866787:0:6671:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1790946374.866812:0:6671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146b1933400/0x16e41aef93271a9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271aa6 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946374.866825:0:6671:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9146b1933400/0x16e41aef93271a9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271aa6 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790946374.866834:0:6671:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9146be38b800 from 1 10000000:01000000:2.0:1790946374.866837:0:6671:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790946374.866883:0:6671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146c20cb600/0x16e41aef93271abb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946374.866891:0:6671:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9146c20cb600/0x16e41aef93271abb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946374.866902:0:6671:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9146c20cb600/0x16e41aef93271abb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946374.866924:0:6671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914685637480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:6671:1877943303281664:0@lo:101: 00000100:00100000:2.0:1790946374.867008:0:6671:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946374.867054:0:6671:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146867d1300 going to sleep for 11 seconds 00000100:00100000:2.0:1790946374.874734:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303281664 00000100:00100000:2.0:1790946374.874750:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303281664 00000100:00100000:2.0:1790946374.874811:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790946374.874821:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+11:6671:x1877943303281664:12345-0@lo:101: 00010000:00010000:2.0:1790946374.874838:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946374.874855:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9146c20caa00/0x16e41aef93271ac2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x16e41aef93271abb expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946374.874900:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9146c20caa00/0x16e41aef93271ac2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x16e41aef93271abb expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946374.874911:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9146c20caa00/0x16e41aef93271ac2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93271abb expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946374.874920:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146c20caa00, rc 0) 00000100:00100000:2.0:1790946374.875023:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+12:6671:x1877943303281664:12345-0@lo:101: Request processed in 203us (8014us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946374.875030:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1790946374.875060:0:6671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914685637480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:6671:1877943303281664:0@lo:101: 00010000:00010000:3.0:1790946374.875092:0:6671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9146c20cb600/0x16e41aef93271abb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271ac2 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946374.875103:0:6671:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9146c20cb600/0x16e41aef93271abb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93271ac2 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946374.875290:0:6671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914682eac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:6671:1877943303281792:0@lo:501: 00000100:00100000:3.0:1790946374.875331:0:6671:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946374.875365:0:6671:0:(client.c:2716:ptlrpc_set_wait()) set ffff914698bb6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790946374.875383:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303281792 00000100:00100000:3.0:1790946374.875388:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303281792 00000100:00100000:3.0:1790946374.875414:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790946374.875423:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+12:6671:x1877943303281792:12345-0@lo:501: 00000100:00100000:3.0:1790946374.875653:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+12:6671:x1877943303281792:12345-0@lo:501: Request processed in 220us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946374.875660:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790946374.879040:0:6671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914682eac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:6671:1877943303281792:0@lo:501: 00000100:00100000:2.0:1790946374.879119:0:6671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914685635180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:6671:1877943303281920:0@lo:503: 00000100:00100000:2.0:1790946374.879242:0:6671:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946374.879283:0:6671:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146867d1a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790946374.883062:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303281920 00000100:00100000:1.0:1790946374.883087:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303281920 00000100:00100000:1.0:1790946374.883150:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790946374.883159:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+12:6671:x1877943303281920:12345-0@lo:503: 00000100:00100000:1.0:1790946374.883463:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+12:6671:x1877943303281920:12345-0@lo:503: Request processed in 305us (4221us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946374.883471:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790946374.883480:0:6671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914685635180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:6671:1877943303281920:0@lo:503: 00000040:00080000:2.0:1790946374.883761:0:6671:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790946374.883915:0:6671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914685635180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:6671:1877943303282048:0@lo:502: 00000100:00100000:2.0:1790946374.883965:0:6671:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946374.884016:0:6671:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146867d1a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790946374.884169:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303282048 00000100:00100000:1.0:1790946374.884176:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303282048 00000100:00100000:1.0:1790946374.884263:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790946374.884271:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+12:6671:x1877943303282048:12345-0@lo:502: 00000100:00100000:1.0:1790946374.884426:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+12:6671:x1877943303282048:12345-0@lo:502: Request processed in 156us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946374.884433:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790946374.885297:0:6671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914685635180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:6671:1877943303282048:0@lo:502: 00000040:00080000:3.0:1790946374.885598:0:6671:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1790946374.885799:0:6671:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1790946374.885839:0:6671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914682eac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:6671:1877943303282176:0@lo:502: 00000100:00100000:3.0:1790946374.885903:0:6671:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946374.885958:0:6671:0:(client.c:2716:ptlrpc_set_wait()) set ffff914698bb6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790946374.886099:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303282176 00000100:00100000:1.0:1790946374.886107:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303282176 00000100:00100000:1.0:1790946374.886154:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1790946374.886163:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+12:6671:x1877943303282176:12345-0@lo:502: 00000100:00100000:0.0:1790946374.886944:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+12:6671:x1877943303282176:12345-0@lo:502: Request processed in 624us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946374.886956:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1790946374.886997:0:6671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914682eac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:6671:1877943303282176:0@lo:502: 00000040:00080000:1.0:1790946374.887118:0:6671:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1790946374.887132:0:6671:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1790946374.888011:0:6695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790946374.888022:0:6695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790946374.888025:0:6695:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1790946374.888031:0:6695:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9146be38b800 00000020:00000080:1.0:1790946374.888034:0:6695:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790946374.888053:0:6695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790946374.888057:0:6695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790946374.888058:0:6695:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1790946374.888071:0:6695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1790946374.888391:0:6671:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1790946374.888417:0:6671:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790946374.888446:0:6671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146c20cb600/0x16e41aef93271abb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271ac2 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946374.888458:0:6671:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9146c20cb600/0x16e41aef93271abb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271ac2 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790946374.888498:0:6671:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1790946374.888501:0:6671:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9146be38b800 10000000:01000000:3.0:1790946374.888503:0:6671:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9146be38b800 10000000:01000000:3.0:1790946374.888508:0:6671:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790946374.888513:0:6671:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9146be38b800 from 1 10000000:01000000:3.0:1790946374.888516:0:6671:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790946374.888548:0:6671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146b1933800/0x16e41aef93271ac9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946374.888557:0:6671:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9146b1933800/0x16e41aef93271ac9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946374.888568:0:6671:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9146b1933800/0x16e41aef93271ac9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946374.888587:0:6671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914682eaf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:6671:1877943303282304:0@lo:101: 00000100:00100000:3.0:1790946374.888665:0:6671:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946374.888710:0:6671:0:(client.c:2716:ptlrpc_set_wait()) set ffff91468eb6e480 going to sleep for 11 seconds 00000100:00100000:0.0:1790946374.888913:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303282304 00000100:00100000:0.0:1790946374.888921:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303282304 00000100:00100000:0.0:1790946374.888963:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790946374.888998:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+12:6671:x1877943303282304:12345-0@lo:101: 00010000:00010000:0.0:1790946374.889012:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946374.889027:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff914680031600/0x16e41aef93271ad0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x16e41aef93271ac9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946374.889051:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff914680031600/0x16e41aef93271ad0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x16e41aef93271ac9 expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946374.889062:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff914680031600/0x16e41aef93271ad0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93271ac9 expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946374.889070:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914680031600, rc 0) 00000100:00100000:0.0:1790946374.889119:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+13:6671:x1877943303282304:12345-0@lo:101: Request processed in 147us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946374.889133:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1790946374.889439:0:6671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914682eaf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:6671:1877943303282304:0@lo:101: 00010000:00010000:3.0:1790946374.889455:0:6671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9146b1933800/0x16e41aef93271ac9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271ad0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946374.889464:0:6671:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9146b1933800/0x16e41aef93271ac9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93271ad0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946374.889561:0:6671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914682eaf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:6671:1877943303282432:0@lo:501: 00000100:00100000:3.0:1790946374.889588:0:6671:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946374.889610:0:6671:0:(client.c:2716:ptlrpc_set_wait()) set ffff91468eb6e480 going to sleep for 11 seconds 00000100:00100000:1.0:1790946374.889661:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303282432 00000100:00100000:1.0:1790946374.889667:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303282432 00000100:00100000:1.0:1790946374.889700:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790946374.889708:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+13:6671:x1877943303282432:12345-0@lo:501: 00000100:00100000:1.0:1790946374.889929:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+13:6671:x1877943303282432:12345-0@lo:501: Request processed in 220us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946374.889947:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790946374.890168:0:6671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914682eaf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:6671:1877943303282432:0@lo:501: 00000100:00100000:3.0:1790946374.890194:0:6671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914682eaf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:6671:1877943303282560:0@lo:503: 00000100:00100000:3.0:1790946374.890512:0:6671:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946374.890546:0:6671:0:(client.c:2716:ptlrpc_set_wait()) set ffff91468eb6e480 going to sleep for 11 seconds 00000100:00100000:0.0:1790946374.890936:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303282560 00000100:00100000:0.0:1790946374.890942:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303282560 00000100:00100000:0.0:1790946374.890990:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790946374.890998:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+13:6671:x1877943303282560:12345-0@lo:503: 00000100:00100000:0.0:1790946374.891167:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+13:6671:x1877943303282560:12345-0@lo:503: Request processed in 169us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946374.891174:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790946374.892685:0:6671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914682eaf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:6671:1877943303282560:0@lo:503: 00000040:00080000:3.0:1790946374.893029:0:6671:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790946374.893107:0:6671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914682eaf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:6671:1877943303282688:0@lo:502: 00000100:00100000:3.0:1790946374.893173:0:6671:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946374.894324:0:6671:0:(client.c:2716:ptlrpc_set_wait()) set ffff91468eb6e480 going to sleep for 11 seconds 00000100:00100000:2.0:1790946374.894573:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303282688 00000100:00100000:2.0:1790946374.894584:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303282688 00000100:00100000:2.0:1790946374.895503:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790946374.895520:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+13:6671:x1877943303282688:12345-0@lo:502: 00000100:00100000:2.0:1790946374.895842:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+13:6671:x1877943303282688:12345-0@lo:502: Request processed in 328us (2667us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946374.895861:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790946374.899626:0:6671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914682eaf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:6671:1877943303282688:0@lo:502: 00000040:00080000:1.0:1790946374.899966:0:6671:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1790946374.900039:0:6671:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1790946374.900081:0:6671:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1790946374.900130:0:6671:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1790946374.900168:0:6671:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1790946374.900237:0:6671:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1790946374.900277:0:6671:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1790946374.900312:0:6671:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1790946374.900373:0:6671:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1790946374.900410:0:6671:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1790946374.900442:0:6671:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1790946374.900504:0:6671:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1790946374.900540:0:6671:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1790946374.900572:0:6671:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1790946374.900614:0:6671:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1790946374.900650:0:6671:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1790946374.900684:0:6671:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1790946374.900729:0:6671:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1790946374.900765:0:6671:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1790946374.900799:0:6671:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1790946374.900848:0:6671:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1790946374.900884:0:6671:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1790946374.900928:0:6671:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1790946374.900989:0:6671:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1790946374.901027:0:6671:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1790946374.901058:0:6671:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1790946374.901104:0:6671:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1790946374.901156:0:6671:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:1.0:1790946374.901232:0:6671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b68a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:6671:1877943303282816:0@lo:502: 00000100:00100000:1.0:1790946374.901313:0:6671:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946374.902089:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303282816 00000100:00100000:2.0:1790946374.902098:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303282816 00010000:00010000:1.0:1790946374.904656:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946374.904691:0:6671:0:(client.c:2716:ptlrpc_set_wait()) set ffff914584b3c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790946374.909456:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790946374.909478:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+13:6671:x1877943303282816:12345-0@lo:502: 00000100:00100000:2.0:1790946374.910271:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+13:6671:x1877943303282816:12345-0@lo:502: Request processed in 800us (8955us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946374.910279:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790946374.910599:0:6671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b68a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:6671:1877943303282816:0@lo:502: 00000040:00080000:2.0:1790946374.911014:0:6671:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1790946374.911029:0:6671:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1790946374.915654:0:6696:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1790946374.915693:0:6696:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9146c1ca19c0) 00000020:00000080:1.0:1790946374.915716:0:6696:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1790946374.915806:0:6696:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9146be38b800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1790946374.915810:0:6696:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9146be38b800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1790946374.915813:0:6696:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9146be38b800 3 00010000:00080000:1.0:1790946374.915844:0:6696:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9146bdcea000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.113@tcp at head 00010000:00010000:1.0:1790946374.917494:0:6696:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1790946374.917713:0:6696:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1790946374.917746:0:6696:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1790946374.917756:0:6696:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x16e41aef93271ade 00000100:00080000:1.0:1790946374.917765:0:6696:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790946374.917775:0:6696:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9146bdcea000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:1.0:1790946374.917811:0:6696:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9146b68a8000 x1877943303282944/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790946374.917841:0:6696:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1790946374.919428:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b68a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3299:1877943303282944:0@lo:38: 00000100:00100000:0.0:1790946374.919517:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946374.919632:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303282944 00000100:00100000:3.0:1790946374.919655:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303282944 00000100:00100000:3.0:1790946374.919698:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790946374.919704:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bdcc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3299:x1877943303282944:12345-0@lo:38: 00010000:00080000:3.0:1790946374.919731:0:5836:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 159 last 0 00000020:00000080:3.0:1790946374.919764:0:5836:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x16e41aef93271ae5 00000004:00100000:3.0:1790946374.919779:0:5836:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1790946374.919811:0:5836:0:(import.c:65:import_set_state_nolock()) ffff9146bc867800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790946374.919870:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bdcc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1877943303282944:12345-0@lo:38: Request processed in 164us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946374.919877:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1790946374.919923:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9146b68a8000 x1877943303282944/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790946384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946374.920153:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790946374.920163:0:3299:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1790946374.920170:0:3299:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1790946374.920174:0:3299:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1790946374.920176:0:3299:0:(import.c:65:import_set_state_nolock()) ffff9146bdcea000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1790946374.920183:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b68a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3299:1877943303282944:0@lo:38: 00000040:00080000:1.0:1790946374.921470:0:6696:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1790946374.921921:0:6671:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1790946374.921947:0:6671:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790946374.921971:0:6671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146b1933800/0x16e41aef93271ac9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271ad0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946374.921992:0:6671:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9146b1933800/0x16e41aef93271ac9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271ad0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1790946374.922037:0:6671:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1790946374.922039:0:6671:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790946374.922040:0:6671:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790946374.922042:0:6671:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790946374.922043:0:6671:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790946374.922044:0:6671:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790946374.922046:0:6671:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790946374.922047:0:6671:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790946374.922048:0:6671:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790946374.922049:0:6671:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790946374.922051:0:6671:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790946374.922057:0:6671:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1790946374.922060:0:6671:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790946374.922061:0:6671:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790946374.922062:0:6671:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790946374.922063:0:6671:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790946374.922064:0:6671:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790946374.922065:0:6671:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790946374.922066:0:6671:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790946374.922067:0:6671:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790946374.922068:0:6671:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790946374.922068:0:6671:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790946374.922069:0:6671:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790946374.922094:0:6671:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1790946374.922112:0:6671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914685634e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:6671:1877943303283072:0@lo:253: 00000100:00100000:2.0:1790946374.922192:0:6671:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946374.922275:0:6671:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146867d1780 going to sleep for 11 seconds 00000100:00100000:0.0:1790946374.924083:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303283072 00000100:00100000:0.0:1790946374.924097:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303283072 00000100:00100000:0.0:1790946374.924160:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790946374.924170:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+13:6671:x1877943303283072:12345-0@lo:253: 20000000:01000000:0.0:1790946374.924217:0:5828:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1790946374.924234:0:5828:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1790946374.978250:0:5828:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1790946374.978268:0:5828:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1790946374.980894:0:5850:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1790946374.980904:0:5850:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1790946374.980928:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9146c20cbc00/0x16e41aef93271aec lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946374.980946:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9146b1932800/0x16e41aef93271a4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93271a44 expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946374.980954:0:5850:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9146c20cbc00/0x16e41aef93271aec lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946374.981004:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9146b1932800/0x16e41aef93271a4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x16e41aef93271a44 expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946374.981019:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9146b1932800/0x16e41aef93271a4b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x16e41aef93271a44 expref: 13 pid: 5829 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946374.981034:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914685636300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5850:1877943303283200:0@lo:104: 00000100:00100000:2.0:1790946374.981115:0:5850:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946374.981281:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146901eb480 going to sleep for 11 seconds 00000100:00100000:3.0:1790946374.982024:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303283200 00000100:00100000:3.0:1790946374.982035:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303283200 00000100:00100000:3.0:1790946374.982093:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790946374.982103:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914685637b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+3:5850:x1877943303283200:12345-0@lo:104: 00010000:00010000:3.0:1790946374.982119:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff914680030600/0x16e41aef93271a44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93271a4b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946374.982227:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790946374.982233:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914685637b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+3:5850:x1877943303283200:12345-0@lo:104: Request processed in 132us (1118us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946374.982239:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1790946374.982347:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946374.982355:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff914680030600/0x16e41aef93271a44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93271a4b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946374.982362:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914680030600 already unused, calling callback (ffffffffc1d96c20) 10000000:00010000:2.0:1790946374.982366:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff914680030600/0x16e41aef93271a44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x16e41aef93271a4b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946374.982374:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff914680030600/0x16e41aef93271a44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x16e41aef93271a4b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790946374.982381:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff914680030600/0x16e41aef93271a44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x16e41aef93271a4b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790946374.982386:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790946374.982425:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff914680030600/0x16e41aef93271a44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271a4b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946374.982432:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790946374.982456:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff914680030600/0x16e41aef93271a44 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271a4b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946374.982462:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff914680030600/0x16e41aef93271a44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271a4b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946374.982479:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946374.982481:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946374.982483:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946374.982512:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914685636300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5850:1877943303283200:0@lo:104: 00010000:00010000:2.0:1790946374.982545:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9146c20cbc00/0x16e41aef93271aec lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946374.982603:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914685635880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3300:1877943303283328:0@lo:103: 00000100:00100000:3.0:1790946374.982655:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946374.982737:0:5821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303283328 00000100:00100000:2.0:1790946374.982743:0:5821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303283328 00010000:00010000:2.0:1790946374.984925:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9146b1932800/0x16e41aef93271a4b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef93271a44 expref: 14 pid: 5829 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946374.984969:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790946374.984993:0:5821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914685715850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+14:3300:x1877943303283328:12345-0@lo:103: 00010000:00010000:2.0:1790946374.985007:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790946374.985012:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9146b1932800/0x16e41aef93271a4b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef93271a44 expref: 14 pid: 5829 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946374.985024:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9146b1932800/0x16e41aef93271a4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x16e41aef93271a44 expref: 14 pid: 5829 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946374.985043:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9146b1932800/0x16e41aef93271a4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x16e41aef93271a44 expref: 14 pid: 5829 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946374.985060:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9146c20cbc00/0x16e41aef93271aec lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946374.985068:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9146c20cbc00/0x16e41aef93271aec lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790946374.985085:0:5821:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004181117s 00010000:00010000:2.0:1790946374.985089:0:5821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9146c20cbc00/0x16e41aef93271aec lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946374.985095:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9146c20cbc00/0x16e41aef93271aec lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946374.985116:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9146c20cbc00/0x16e41aef93271aec lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946374.985124:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9146c20cbc00/0x16e41aef93271aec lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946374.985130:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146c20cbc00 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:2.0:1790946374.985134:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9146c20cbc00/0x16e41aef93271aec lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946374.985143:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9146c20cbc00/0x16e41aef93271aec lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946374.985159:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9146c20cbc00/0x16e41aef93271aec lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946374.985170:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790946374.985256:0:5821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914685715850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+13:3300:x1877943303283328:12345-0@lo:103: Request processed in 270us (2601us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946374.985263:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790946374.985333:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914685635880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3300:1877943303283328:0@lo:103: 00010000:00010000:2.0:1790946374.985357:0:5850:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9146c20cbc00/0x16e41aef93271aec lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946374.985364:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9146c20cbc00/0x16e41aef93271aec lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946374.985371:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9146c20cbc00/0x16e41aef93271aec lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946374.986955:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+12:6671:x1877943303283072:12345-0@lo:253: Request processed in 62780us (64757us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946374.986990:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1790946374.987084:0:6671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914685634e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:6671:1877943303283072:0@lo:253: 10000000:01000000:2.0:1790946374.987111:0:6671:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1790946374.987115:0:6671:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790946374.987117:0:6671:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790946374.987119:0:6671:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790946374.987120:0:6671:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790946374.987121:0:6671:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790946374.987123:0:6671:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790946374.987124:0:6671:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790946374.987126:0:6671:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790946374.987127:0:6671:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790946374.987129:0:6671:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790946374.987130:0:6671:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1790946374.987142:0:6671:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1790946374.992746:0:6671:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1790946374.992946:0:6671:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1790946374.993172:0:6671:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1790946374.993565:0:6671:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1790946374.993833:0:6671:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1790946374.994065:0:6671:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1790946374.997145:0:6671:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1790946375.289670:0:6671:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1790946375.289678:0:6671:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1790946375.289717:0:6671:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1790946375.289774:0:6671:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.113@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1790946375.289793:0:6671:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1790946375.289820:0:6671:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1790946375.921295:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946376.954560:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1790946376.954656:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1790946376.954661:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9146aa748800 from 21 10000000:01000000:2.0:1790946376.954725:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790946376.954779:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146c20ca200/0x16e41aef93271af3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946376.954806:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9146c20ca200/0x16e41aef93271af3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946376.954816:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9146c20ca200/0x16e41aef93271af3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946376.954849:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914685634e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303283456:0@lo:101: 00000100:00100000:2.0:1790946376.954920:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946376.955020:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff91458665f900 going to sleep for 11 seconds 00000100:00100000:3.0:1790946376.955068:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303283456 00000100:00100000:3.0:1790946376.955163:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303283456 00000100:00100000:3.0:1790946376.956003:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1790946376.956017:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+12:5831:x1877943303283456:12345-0@lo:101: 00010000:00010000:3.0:1790946376.956032:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946376.956055:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9146b1933a00/0x16e41aef93271afa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x16e41aef93271af3 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946376.956094:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9146b1933a00/0x16e41aef93271afa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x16e41aef93271af3 expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946376.956105:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9146b1933a00/0x16e41aef93271afa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93271af3 expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946376.956114:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b1933a00, rc 0) 00000100:00100000:3.0:1790946376.956176:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+13:5831:x1877943303283456:12345-0@lo:101: Request processed in 164us (1256us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946376.956183:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1790946376.956296:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914685634e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303283456:0@lo:101: 00010000:00010000:0.0:1790946376.956315:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9146c20ca200/0x16e41aef93271af3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271afa expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946376.956324:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9146c20ca200/0x16e41aef93271af3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93271afa expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946376.956388:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bdcc9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303283584:0@lo:501: 00000100:00100000:0.0:1790946376.956418:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946376.956683:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff914682df5f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790946376.956801:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303283584 00000100:00100000:2.0:1790946376.956809:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303283584 00000100:00100000:2.0:1790946376.956836:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790946376.956842:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+13:5831:x1877943303283584:12345-0@lo:501: 00000100:00100000:2.0:1790946376.957656:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+13:5831:x1877943303283584:12345-0@lo:501: Request processed in 811us (1234us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946376.957746:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790946376.957799:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bdcc9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303283584:0@lo:501: 00000100:00100000:2.0:1790946376.957842:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914685635880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303283712:0@lo:503: 00000100:00100000:2.0:1790946376.957885:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946376.957911:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff91458665f180 going to sleep for 11 seconds 00000100:00100000:2.0:1790946376.957924:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303283712 00000100:00100000:2.0:1790946376.957929:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303283712 00000100:00100000:2.0:1790946376.957951:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790946376.957969:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+13:5831:x1877943303283712:12345-0@lo:503: 00000100:00100000:3.0:1790946376.958758:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+13:5831:x1877943303283712:12345-0@lo:503: Request processed in 797us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946376.958766:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790946376.958834:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914685635880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303283712:0@lo:503: 00000100:00100000:3.0:1790946376.961450:0:6787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914682ead500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:6787:1877943303283840:0@lo:502: 00000100:00100000:3.0:1790946376.961520:0:6787:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946376.961561:0:6787:0:(client.c:2716:ptlrpc_set_wait()) set ffff91468749c240 going to sleep for 11 seconds 00000100:00100000:2.0:1790946376.961565:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303283840 00000100:00100000:2.0:1790946376.961573:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303283840 00000100:00100000:2.0:1790946376.961657:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790946376.961731:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468494e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+13:6787:x1877943303283840:12345-0@lo:502: 00000100:00100000:2.0:1790946376.961979:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468494e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+13:6787:x1877943303283840:12345-0@lo:502: Request processed in 313us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946376.961987:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790946376.962004:0:6787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914682ead500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:6787:1877943303283840:0@lo:502: 00000100:00100000:3.0:1790946376.962232:0:6787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914682ead500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:6787:1877943303283968:0@lo:502: 00000100:00100000:3.0:1790946376.962451:0:6787:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946376.962506:0:6787:0:(client.c:2716:ptlrpc_set_wait()) set ffff91468749c240 going to sleep for 11 seconds 00000100:00100000:2.0:1790946376.962536:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303283968 00000100:00100000:2.0:1790946376.962540:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303283968 00000100:00100000:2.0:1790946376.962594:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1790946376.962601:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468494c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+13:6787:x1877943303283968:12345-0@lo:502: 00000100:00100000:2.0:1790946376.962858:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468494c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+13:6787:x1877943303283968:12345-0@lo:502: Request processed in 256us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946376.962865:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790946376.962954:0:6787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914682ead500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:6787:1877943303283968:0@lo:502: 00000040:00080000:3.0:1790946376.962991:0:6787:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1790946376.963158:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1790946376.963185:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790946376.963196:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146c20ca200/0x16e41aef93271af3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271afa expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946376.963229:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9146c20ca200/0x16e41aef93271af3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271afa expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790946376.963239:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790946376.963242:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9146aa748800 from 4 10000000:01000000:0.0:1790946376.963245:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790946376.963285:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff914680030c00/0x16e41aef93271b01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946376.963295:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff914680030c00/0x16e41aef93271b01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946376.963304:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff914680030c00/0x16e41aef93271b01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946376.963320:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bdccb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303284096:0@lo:101: 00000100:00100000:0.0:1790946376.963355:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946376.963372:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff914682df5e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790946376.963954:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303284096 00000100:00100000:2.0:1790946376.963971:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303284096 00000100:00100000:2.0:1790946376.964046:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790946376.964054:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468494c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+13:5831:x1877943303284096:12345-0@lo:101: 00010000:00010000:2.0:1790946376.964067:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946376.964092:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9146c20cac00/0x16e41aef93271b08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x16e41aef93271b01 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946376.964114:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9146c20cac00/0x16e41aef93271b08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x16e41aef93271b01 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946376.964125:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9146c20cac00/0x16e41aef93271b08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93271b01 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946376.964144:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146c20cac00, rc 0) 00000100:00100000:2.0:1790946376.964194:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468494c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+14:5831:x1877943303284096:12345-0@lo:101: Request processed in 141us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946376.964218:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790946376.964296:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bdccb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303284096:0@lo:101: 00010000:00010000:3.0:1790946376.964310:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff914680030c00/0x16e41aef93271b01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271b08 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946376.964325:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff914680030c00/0x16e41aef93271b01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93271b08 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946376.964366:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914682ead500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303284224:0@lo:256: 00000100:00100000:3.0:1790946376.964395:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946376.965389:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff91468749c240 going to sleep for 11 seconds 00000100:00100000:0.0:1790946376.965438:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303284224 00000100:00100000:0.0:1790946376.965446:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303284224 00000100:00100000:0.0:1790946376.965483:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1790946376.965492:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468494e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+14:5831:x1877943303284224:12345-0@lo:256: 20000000:01000000:0.0:1790946376.965511:0:5828:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790946376.965528:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790946376.965531:0:5828:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1790946376.965799:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468494e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+14:5831:x1877943303284224:12345-0@lo:256: Request processed in 307us (1402us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946376.965807:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790946376.965878:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914682ead500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303284224:0@lo:256: 10000000:01000000:3.0:1790946376.965922:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790946376.965930:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff914680030c00/0x16e41aef93271b01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271b08 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946376.965942:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff914680030c00/0x16e41aef93271b01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271b08 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790946376.965950:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1790946376.965953:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1790946376.965955:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1790946376.965987:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146b1932400/0x16e41aef93271b0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946376.965995:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9146b1932400/0x16e41aef93271b0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946376.966004:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9146b1932400/0x16e41aef93271b0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946376.966017:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914682ead500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303284352:0@lo:101: 00000100:00100000:3.0:1790946376.966054:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946376.966106:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff91468749c240 going to sleep for 11 seconds 00000100:00100000:2.0:1790946376.966166:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303284352 00000100:00100000:2.0:1790946376.966171:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303284352 00000100:00100000:2.0:1790946376.966358:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790946376.966366:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468494e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+14:5831:x1877943303284352:12345-0@lo:101: 00010000:00010000:2.0:1790946376.966376:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946376.966389:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9146c20cbc00/0x16e41aef93271b16 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x16e41aef93271b0f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946376.966408:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9146c20cbc00/0x16e41aef93271b16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x16e41aef93271b0f expref: 15 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946376.966418:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9146c20cbc00/0x16e41aef93271b16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93271b0f expref: 15 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946376.966426:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146c20cbc00, rc 0) 00000100:00100000:2.0:1790946376.966456:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468494e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+15:5831:x1877943303284352:12345-0@lo:101: Request processed in 91us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946376.966462:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1790946376.966546:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914682ead500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303284352:0@lo:101: 00010000:00010000:3.0:1790946376.966557:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9146b1932400/0x16e41aef93271b0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271b16 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946376.966566:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9146b1932400/0x16e41aef93271b0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93271b16 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946376.966609:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914682ead500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303284480:0@lo:501: 00000100:00100000:3.0:1790946376.966631:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946376.966694:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff91468749c240 going to sleep for 11 seconds 00000100:00100000:0.0:1790946376.966775:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303284480 00000100:00100000:0.0:1790946376.966780:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303284480 00000100:00100000:0.0:1790946376.966829:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1790946376.966835:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468494f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+15:5831:x1877943303284480:12345-0@lo:501: 00000100:00100000:0.0:1790946376.967094:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468494f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+15:5831:x1877943303284480:12345-0@lo:501: Request processed in 258us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946376.967101:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1790946376.967196:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914682ead500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303284480:0@lo:501: 00000100:00100000:3.0:1790946376.967358:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914682ead500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303284608:0@lo:503: 00000100:00100000:3.0:1790946376.967397:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946376.967462:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff91468749c240 going to sleep for 11 seconds 00000100:00100000:0.0:1790946376.967493:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303284608 00000100:00100000:0.0:1790946376.967498:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303284608 00000100:00100000:0.0:1790946376.967562:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1790946376.967570:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468494d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+15:5831:x1877943303284608:12345-0@lo:503: 00000100:00100000:0.0:1790946376.967996:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468494d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+15:5831:x1877943303284608:12345-0@lo:503: Request processed in 427us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946376.968004:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790946376.968096:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914682ead500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303284608:0@lo:503: 00000100:00100000:2.0:1790946376.968509:0:6788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914685635880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:6788:1877943303284736:0@lo:502: 00000100:00100000:2.0:1790946376.968551:0:6788:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946376.968584:0:6788:0:(client.c:2716:ptlrpc_set_wait()) set ffff91458665f900 going to sleep for 11 seconds 00000100:00100000:3.0:1790946376.968632:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303284736 00000100:00100000:3.0:1790946376.968638:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303284736 00000100:00100000:3.0:1790946376.968748:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790946376.968757:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468494dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+15:6788:x1877943303284736:12345-0@lo:502: 00000100:00100000:3.0:1790946376.968985:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468494dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+15:6788:x1877943303284736:12345-0@lo:502: Request processed in 229us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946376.968992:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1790946376.969072:0:6788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914685635880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:6788:1877943303284736:0@lo:502: 00000020:01000000:2.0:1790946376.969100:0:6788:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790946376.969106:0:6788:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1790946376.969112:0:6788:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946376.969114:0:6788:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1790946376.969119:0:6788:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1790946376.969122:0:6788:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.113@tcp to nid 0x20000c0a8cb71 (192.168.203.113@tcp) 00000020:01000000:2.0:1790946376.969143:0:6788:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1790946376.969145:0:6788:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790946376.969158:0:6788:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff914684fb0000) 00000020:00000080:2.0:1790946376.969178:0:6788:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1790946376.969182:0:6788:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1790946376.969332:0:6788:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1790946376.969338:0:6788:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:2.0:1790946376.969344:0:6788:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x16e41aef93271b24 00010000:00080000:2.0:1790946376.969370:0:6788:0:(ldlm_lib.c:102:import_set_conn()) imp ffff914584b9f000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.113@tcp at head 00010000:00010000:2.0:1790946376.969572:0:6788:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1790946377.076267:0:6788:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1790946377.076291:0:6788:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1790946377.079010:0:6788:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790946377.079238:0:6788:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790946377.079289:0:6788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1790946377.079349:0:6788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1790946377.087234:0:6801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790946377.087242:0:6801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1790946377.088854:0:6788:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790946377.088871:0:6788:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1790946377.088907:0:6788:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1790946377.088932:0:6788:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x16e41aef93271b2b 00000100:00080000:1.0:1790946377.088941:0:6788:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790946377.088963:0:6788:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff914584b9f000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:1.0:1790946377.089002:0:6788:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9146b68ab480 x1877943303284864/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790946377.089030:0:6788:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1790946377.089098:0:6788:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790946377.089103:0:6788:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790946377.089105:0:6788:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1790946377.089108:0:6788:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790946377.089112:0:6788:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790946377.089114:0:6788:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790946377.089116:0:6788:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790946377.089119:0:6788:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1790946377.089147:0:6788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b68a9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:6788:1877943303284992:0@lo:502: 00000100:00100000:1.0:1790946377.089254:0:6788:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946377.089299:0:6788:0:(client.c:2716:ptlrpc_set_wait()) set ffff91468298f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790946377.089429:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790946377.089442:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bdcca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877943303285120:0@lo:400: 00000100:00100000:2.0:1790946377.089480:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946377.089577:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bdccad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1877943303285248:0@lo:400: 00000100:00100000:1.0:1790946377.089623:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946377.089745:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303285120 00000100:00100000:0.0:1790946377.089752:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303285120 00000100:00100000:0.0:1790946377.089796:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303285248 00000100:00100000:0.0:1790946377.089799:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303285248 00000100:00100000:0.0:1790946377.089826:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790946377.089833:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914685635880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877943303285120:12345-0@lo:400: 00000100:00100000:1.0:1790946377.089927:0:5834:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1790946377.089935:0:5834:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1790946377.090187:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b68ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1877943303284864:0@lo:8: 00000100:00100000:3.0:1790946377.090247:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946377.090298:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303284992 00000100:00100000:3.0:1790946377.090303:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303284992 00000100:00100000:3.0:1790946377.090332:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790946377.090340:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468494cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+15:6788:x1877943303284992:12345-0@lo:502: 00000100:00100000:3.0:1790946377.090800:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468494cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+15:6788:x1877943303284992:12345-0@lo:502: Request processed in 421us (1507us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946377.090868:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914685635880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877943303285120:12345-0@lo:400: Request processed in 1034us (1387us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946377.090877:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790946377.090898:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790946377.090906:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b68a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877943303285248:12345-0@lo:400: 00000100:00100000:0.0:1790946377.090947:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b68a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877943303285248:12345-0@lo:400: Request processed in 42us (1323us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946377.090953:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1790946377.090981:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1790946377.091055:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9146bdccad80 x1877943303285248/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946377.091069:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bdccad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1877943303285248:0@lo:400: 00000100:00100000:3.0:1790946377.091089:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790946377.091144:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303284864 00000100:00100000:3.0:1790946377.091150:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303284864 00000100:00100000:3.0:1790946377.091178:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790946377.091184:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682ead500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3299:x1877943303284864:12345-0@lo:8: 00010000:00080000:3.0:1790946377.091231:0:6673:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 162 last 0 00000020:00000080:3.0:1790946377.091261:0:6673:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x16e41aef93271b32 00002000:00100000:3.0:1790946377.091298:0:6673:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9145853b7000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b03 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1790946377.091303:0:6673:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1790946377.091307:0:6673:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1790946377.091416:0:6673:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1790946377.091549:0:6673:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1790946377.091572:0:6673:0:(import.c:65:import_set_state_nolock()) ffff9145853b3800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790946377.091641:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682ead500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3299:x1877943303284864:12345-0@lo:8: Request processed in 455us (1393us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946377.091648:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790946377.091701:0:6788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b68a9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:6788:1877943303284992:0@lo:502: 00000020:01000000:3.0:1790946377.091733:0:6788:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790946377.091740:0:6788:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790946377.091742:0:6788:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:3.0:1790946377.091747:0:6788:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1790946377.091885:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1790946377.091906:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1790946377.091916:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146b1932400/0x16e41aef93271b0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271b16 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946377.091939:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9146b1932400/0x16e41aef93271b0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271b16 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790946377.091950:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1790946377.091953:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff914682e5b380 from 1 10000000:01000000:1.0:1790946377.091966:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1790946377.092006:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146b180e600/0x16e41aef93271b39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946377.092014:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9146b180e600/0x16e41aef93271b39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946377.092024:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9146b180e600/0x16e41aef93271b39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946377.092041:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b68a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303285376:0@lo:101: 00000100:00100000:1.0:1790946377.092076:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946377.092109:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff914584b3cd80 going to sleep for 11 seconds 00010000:00080000:2.0:1790946377.092369:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9146bdcca680 x1877943303285120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946377.092381:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bdcca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877943303285120:0@lo:400: 00000100:00100000:3.0:1790946377.093680:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303285376 00000100:00100000:3.0:1790946377.093691:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303285376 00000100:00100000:3.0:1790946377.093755:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790946377.093766:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468494c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+15:5831:x1877943303285376:12345-0@lo:101: 00010000:00010000:3.0:1790946377.093783:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946377.093801:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9146b1932800/0x16e41aef93271b40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x16e41aef93271b39 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946377.093828:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9146b1932800/0x16e41aef93271b40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x16e41aef93271b39 expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946377.093839:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9146b1932800/0x16e41aef93271b40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93271b39 expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946377.093848:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b1932800, rc 0) 00000100:00100000:3.0:1790946377.093922:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468494c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+16:5831:x1877943303285376:12345-0@lo:101: Request processed in 158us (1845us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946377.093929:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790946377.094004:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b68a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303285376:0@lo:101: 00010000:00080000:0.0:1790946377.094336:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9146b68ab480 x1877943303284864/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790946387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946377.094347:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790946377.094354:0:3299:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1790946377.094362:0:3299:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1790946377.094366:0:3299:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1790946377.094370:0:3299:0:(import.c:65:import_set_state_nolock()) ffff914584b9f000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1790946377.094382:0:3299:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1790946377.094387:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b68ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1877943303284864:0@lo:8: 00000004:00080000:2.0:1790946377.094505:0:6801:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00010000:00010000:3.0:1790946377.094722:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9146b180e600/0x16e41aef93271b39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271b40 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946377.094734:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9146b180e600/0x16e41aef93271b39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93271b40 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946377.094797:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914682eadf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303285504:0@lo:501: 00000100:00100000:3.0:1790946377.094845:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946377.094887:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff914682b45300 going to sleep for 11 seconds 00000100:00100000:3.0:1790946377.094908:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303285504 00000100:00100000:3.0:1790946377.094919:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303285504 00000100:00100000:3.0:1790946377.094949:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1790946377.094967:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682e30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+16:5831:x1877943303285504:12345-0@lo:501: 00000004:00080000:2.0:1790946377.095267:0:6801:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 162167064341ns, next at 0ns, rc = 0 00000100:00100000:3.0:1790946377.096800:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682e30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+16:5831:x1877943303285504:12345-0@lo:501: Request processed in 1838us (1949us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790946377.096812:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1790946377.097633:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914682eadf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303285504:0@lo:501: 10000000:01000000:0.0:1790946377.097673:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1790946377.097682:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146b180e600/0x16e41aef93271b39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271b40 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946377.097692:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9146b180e600/0x16e41aef93271b39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271b40 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790946377.165140:0:6802:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1790946377.165159:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bdcc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303285632:0@lo:13: 00000100:00100000:0.0:1790946377.165197:0:6802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bdcc8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6802:1877943303285760:0@lo:7: 00000100:00100000:1.0:1790946377.165265:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946377.165265:0:6802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946377.165372:0:6676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303285632 00000100:00100000:1.0:1790946377.165379:0:6676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303285632 00000100:00100000:1.0:1790946377.165433:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790946377.165443:0:6676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b68ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1877943303285632:12345-0@lo:13: 00002000:00000024:1.0:1790946377.165486:0:6676:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1790946377.165531:0:6676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b68ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1877943303285632:12345-0@lo:13: Request processed in 90us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946377.165538:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1790946377.165581:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9146bdcc9180 x1877943303285632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790946393 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946377.165598:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bdcc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303285632:0@lo:13: 00000100:00100000:0.0:1790946377.166081:0:6802:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146912776c0 going to sleep for 11 seconds 00000100:00080000:0.0:1790946377.166128:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790946377.170459:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303285760 00000100:00100000:3.0:1790946377.170475:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303285760 00000100:00100000:3.0:1790946377.170536:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790946377.170546:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bdcca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6802:x1877943303285760:12345-0@lo:7: 00000004:00080000:1.0:1790946377.172293:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:3.0:1790946377.185638:0:6675:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1790946377.185646:0:6675:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1790946377.185751:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bdcca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6802:x1877943303285760:12345-0@lo:7: Request processed in 15202us (20487us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946377.185761:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1790946377.187907:0:6802:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9146bdcc8e00 x1877943303285760/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790946393 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946377.187924:0:6802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bdcc8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6802:1877943303285760:0@lo:7: 00000004:00080000:1.0:1790946377.187938:0:6802:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1790946377.187994:0:6802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b68aa680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6802:1877943303285888:0@lo:5: 00000100:00100000:1.0:1790946377.188063:0:6802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946377.188117:0:6802:0:(client.c:2716:ptlrpc_set_wait()) set ffff914584b3c900 going to sleep for 11 seconds 00000100:00100000:3.0:1790946377.188952:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303285888 00000100:00100000:3.0:1790946377.188972:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303285888 00000100:00100000:3.0:1790946377.189040:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790946377.189050:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b68aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6802:x1877943303285888:12345-0@lo:5: 00000100:00100000:2.0:1790946377.189053:0:6674:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1790946377.189062:0:6674:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00002000:00080000:3.0:1790946377.189080:0:6673:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1790946377.189085:0:6673:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1790946377.189627:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b68aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6802:x1877943303285888:12345-0@lo:5: Request processed in 577us (1562us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1790946377.189637:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1790946377.189684:0:6802:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9146b68aa680 x1877943303285888/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790946393 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946377.189698:0:6802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b68aa680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6802:1877943303285888:0@lo:5: 00000004:00080000:3.0:1790946377.189708:0:6802:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1790946377.189746:0:6802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914682eaca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6802:1877943303286016:0@lo:700: 00000100:00100000:3.0:1790946377.189779:0:6802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946377.189802:0:6802:0:(client.c:2716:ptlrpc_set_wait()) set ffff914682b45480 going to sleep for 11 seconds 00000100:00100000:3.0:1790946377.189822:0:6682:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303286016 00000100:00100000:3.0:1790946377.189826:0:6682:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303286016 00000100:00100000:3.0:1790946377.189945:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790946377.189954:0:6682:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682eadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6802:x1877943303286016:12345-0@lo:700: 00000100:00100000:3.0:1790946377.189993:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914682eaf100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6682:1877943303286144:0@lo:700: 00000100:00100000:3.0:1790946377.190517:0:6682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946377.190547:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff914682b45c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790946377.190575:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303286144 00000100:00100000:3.0:1790946377.190581:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303286144 00000100:00100000:3.0:1790946377.190652:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790946377.190660:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682eaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6682:x1877943303286144:12345-0@lo:700: 40000000:02000000:0.0:1790946377.232379:0:5841:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1790946377.238468:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682eaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6682:x1877943303286144:12345-0@lo:700: Request processed in 47801us (47943us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946377.238487:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1790946377.238607:0:6682:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff914682eaf100 x1877943303286144/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1790946393 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946377.238623:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914682eaf100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6682:1877943303286144:0@lo:700: 40000000:02000000:3.0:1790946377.238636:0:6682:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:3.0:1790946377.356219:0:6700:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1790946377.356235:0:6700:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1790946377.359288:0:6682:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682eadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6802:x1877943303286016:12345-0@lo:700: Request processed in 169325us (169498us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946377.359308:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1790946377.360450:0:6802:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff914682eaca80 x1877943303286016/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1790946393 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946377.360463:0:6802:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1790946377.360480:0:6802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914682eaca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6802:1877943303286016:0@lo:700: 00000004:02000040:2.0:1790946377.429992:0:6802:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:2.0:1790946377.439484:0:6802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914685635500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6802:1877943303286272:0@lo:5: 00000100:00100000:2.0:1790946377.439564:0:6802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946377.440259:0:6802:0:(client.c:2716:ptlrpc_set_wait()) set ffff91458665f780 going to sleep for 11 seconds 00000100:00100000:3.0:1790946377.440694:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303286272 00000100:00100000:3.0:1790946377.440715:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303286272 00000100:00100000:3.0:1790946377.440783:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790946377.440793:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914685636300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6802:x1877943303286272:12345-0@lo:5: 00002000:00080000:2.0:1790946377.454731:0:6675:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1790946377.454751:0:6675:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:2.0:1790946377.459586:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914685636300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6802:x1877943303286272:12345-0@lo:5: Request processed in 18788us (20017us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1790946377.459610:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1790946377.462102:0:6802:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff914685635500 x1877943303286272/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790946393 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946377.462121:0:6802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914685635500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6802:1877943303286272:0@lo:5: 00000004:00080000:3.0:1790946377.462137:0:6802:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:2.0:1790946377.971468:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946378.998541:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946380.016622:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946381.044369:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790946381.276851:0:7045:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1790946382.066382:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946382.323170:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790946382.323213:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914682eaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303286400:0@lo:13: 00000100:00100000:1.0:1790946382.323320:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946382.327463:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b68aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3301:1877943303286528:0@lo:400: 00000100:00100000:1.0:1790946382.327527:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946382.327582:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b68a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877943303286656:0@lo:400: 00000100:00100000:1.0:1790946382.327653:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946382.327675:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790946382.327680:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b68ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1877943303286784:0@lo:400: 00000100:00100000:1.0:1790946382.327700:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946382.327742:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303286528 00000100:00100000:1.0:1790946382.327750:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303286528 00000100:00100000:1.0:1790946382.327794:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790946382.327803:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682e30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+16:3301:x1877943303286528:12345-0@lo:400: 00000100:00100000:1.0:1790946382.327866:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682e30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+16:3301:x1877943303286528:12345-0@lo:400: Request processed in 64us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946382.327873:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790946382.327902:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303286656 00000100:00100000:1.0:1790946382.327906:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303286656 00000100:00100000:1.0:1790946382.327934:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303286784 00000100:00100000:1.0:1790946382.327938:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303286784 00000100:00100000:1.0:1790946382.327964:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790946382.327970:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b68a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877943303286656:12345-0@lo:400: 00000100:00100000:1.0:1790946382.328004:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b68a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877943303286656:12345-0@lo:400: Request processed in 34us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946382.328010:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790946382.328021:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790946382.328026:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b68a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877943303286784:12345-0@lo:400: 00000100:00100000:1.0:1790946382.328054:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b68a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877943303286784:12345-0@lo:400: Request processed in 28us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946382.328060:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790946382.328094:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b68aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3301:1877943303286528:0@lo:400: 00000100:00080000:1.0:1790946382.328117:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1790946382.328136:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9146b68ab480 x1877943303286784/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946382.328147:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b68ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1877943303286784:0@lo:400: 00010000:00080000:1.0:1790946382.328157:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9146b68a8a80 x1877943303286656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946382.328172:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b68a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877943303286656:0@lo:400: 00000100:00100000:3.0:1790946382.330043:0:6676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303286400 00000100:00100000:3.0:1790946382.330058:0:6676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303286400 00000100:00100000:3.0:1790946382.330121:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790946382.330131:0:6676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b68a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1877943303286400:12345-0@lo:13: 00002000:00000024:3.0:1790946382.330167:0:6676:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790946382.330267:0:6676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b68a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1877943303286400:12345-0@lo:13: Request processed in 138us (6946us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946382.330274:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1790946382.346283:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790946382.346428:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff914682eaca80 x1877943303286400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790946398 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946382.346456:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914682eaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303286400:0@lo:13: 00000001:00080000:3.0:1790946382.406781:0:6700:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:0.0:1790946383.088743:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946384.112916:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946385.139793:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946386.161376:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946387.184924:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946387.440581:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b68aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1877943303287168:0@lo:400: 00000100:00100000:1.0:1790946387.440679:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946387.440759:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790946387.440765:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b68ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303287296:0@lo:400: 00000100:00100000:1.0:1790946387.440791:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946387.440852:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303287168 00000100:00100000:1.0:1790946387.440861:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303287168 00000100:00100000:1.0:1790946387.440940:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790946387.440950:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b68a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877943303287168:12345-0@lo:400: 00000100:00100000:1.0:1790946387.441025:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b68a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877943303287168:12345-0@lo:400: Request processed in 76us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946387.441033:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1790946387.441057:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1790946387.441091:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9146b68aa680 x1877943303287168/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946387.441107:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b68aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1877943303287168:0@lo:400: 00000100:00100000:1.0:1790946387.441160:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303287296 00000100:00100000:1.0:1790946387.441164:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303287296 00000100:00100000:1.0:1790946387.441225:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790946387.441233:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b68a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303287296:12345-0@lo:400: 00000100:00100000:1.0:1790946387.441294:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b68a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303287296:12345-0@lo:400: Request processed in 62us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946387.441301:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1790946387.441316:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790946387.441333:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9146b68ab100 x1877943303287296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790946403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946387.441341:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1790946387.441353:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b68ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303287296:0@lo:400: 00000100:00100000:0.0:1790946387.443095:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b68ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1877943303287040:0@lo:400: 00000100:00100000:0.0:1790946387.443190:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946387.443259:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790946387.443267:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b68a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3301:1877943303286912:0@lo:400: 00000100:00100000:0.0:1790946387.443303:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946387.443383:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303286912 00000100:00100000:0.0:1790946387.443391:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303286912 00000100:00100000:0.0:1790946387.443446:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790946387.443456:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682e33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+16:3301:x1877943303286912:12345-0@lo:400: 00000100:00100000:0.0:1790946387.443538:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682e33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+16:3301:x1877943303286912:12345-0@lo:400: Request processed in 83us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946387.443547:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790946387.443602:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b68a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3301:1877943303286912:0@lo:400: 00000100:00100000:1.0:1790946387.443694:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303287040 00000100:00100000:1.0:1790946387.443698:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303287040 00000100:00100000:1.0:1790946387.443750:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790946387.443759:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bdccbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1877943303287040:12345-0@lo:400: 00000100:00100000:1.0:1790946387.443803:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bdccbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1877943303287040:12345-0@lo:400: Request processed in 45us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946387.443809:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1790946387.444161:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9146b68ab480 x1877943303287040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946387.444175:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b68ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1877943303287040:0@lo:400: 00000100:00100000:2.0:1790946387.446626:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914682eaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303287424:0@lo:13: 00000100:00100000:2.0:1790946387.446718:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946387.451664:0:6676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303287424 00000100:00100000:1.0:1790946387.451686:0:6676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303287424 00000100:00100000:1.0:1790946387.451795:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790946387.451816:0:6676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914685636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303287424:12345-0@lo:13: 00002000:00000024:1.0:1790946387.451870:0:6676:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790946387.452818:0:6676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914685636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303287424:12345-0@lo:13: Request processed in 988us (6084us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946387.452830:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1790946387.456537:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff914682eaf100 x1877943303287424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790946403 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946387.456578:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914682eaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303287424:0@lo:13: 00010000:00010000:3.0:1790946388.210918:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946389.235167:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946390.262076:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946391.281356:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946392.304463:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1790946392.555724:0:7629:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1790946392.555728:0:7629:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1790946392.556074:0:7629:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9145853b6000 00000020:01000004:3.0:1790946392.556089:0:7629:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1790946392.556102:0:7629:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1790946392.556116:0:7629:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff91469e0b99c0) 00000020:00000080:3.0:1790946392.556138:0:7629:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00000100:00100000:2.0:1790946392.562329:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914685634e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303287936:0@lo:400: 00000100:00100000:1.0:1790946392.562446:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914685635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3301:1877943303287552:0@lo:400: 00000100:00100000:1.0:1790946392.562524:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946392.562598:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303287552 00000100:00100000:1.0:1790946392.562620:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303287552 00000100:00100000:1.0:1790946392.562666:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790946392.562674:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682e33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+16:3301:x1877943303287552:12345-0@lo:400: 00000100:00100000:1.0:1790946392.562727:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682e33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+16:3301:x1877943303287552:12345-0@lo:400: Request processed in 53us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946392.562735:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790946392.562782:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914685635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3301:1877943303287552:0@lo:400: 00000100:00100000:1.0:1790946392.562988:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bdcc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303288064:0@lo:13: 00000100:00100000:1.0:1790946392.563017:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946392.563099:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303288064 00000100:00100000:0.0:1790946392.563104:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303288064 00000100:00100000:0.0:1790946392.563145:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790946392.563152:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b68ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1877943303288064:12345-0@lo:13: 00002000:00000024:0.0:1790946392.563179:0:6678:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790946392.563231:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b68ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1877943303288064:12345-0@lo:13: Request processed in 79us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946392.563237:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790946392.563400:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946392.563442:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914685634700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877943303287680:0@lo:400: 00000100:00100000:2.0:1790946392.563469:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946392.563499:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790946392.563505:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914685635500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1877943303287808:0@lo:400: 00000100:00080000:1.0:1790946392.563588:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790946392.563616:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9146bdcc9880 x1877943303288064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790946408 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946392.563634:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bdcc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303288064:0@lo:13: 00000100:00100000:0.0:1790946392.563852:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303287680 00000100:00100000:0.0:1790946392.563858:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303287680 00000100:00100000:0.0:1790946392.563932:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790946392.563940:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914685637480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877943303287680:12345-0@lo:400: 00000100:00100000:0.0:1790946392.563981:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914685637480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877943303287680:12345-0@lo:400: Request processed in 43us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946392.563993:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790946392.564028:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946392.564081:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303287936 00000100:00100000:3.0:1790946392.564087:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303287936 00000100:00100000:3.0:1790946392.564114:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790946392.564121:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914685635180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303287936:12345-0@lo:400: 00000100:00100000:3.0:1790946392.564161:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914685635180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303287936:12345-0@lo:400: Request processed in 41us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946392.564167:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790946392.566715:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303287808 00000100:00100000:1.0:1790946392.566731:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303287808 00010000:00080000:2.0:1790946392.566779:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff914685634700 x1877943303287680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946392.566798:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790946392.566807:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914685634a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877943303287808:12345-0@lo:400: 00000100:00100000:2.0:1790946392.566812:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914685634700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877943303287680:0@lo:400: 00010000:00080000:2.0:1790946392.566888:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff914685634e00 x1877943303287936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790946408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946392.566898:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914685634e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303287936:0@lo:400: 00000100:00100000:1.0:1790946392.567645:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914685634a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877943303287808:12345-0@lo:400: Request processed in 836us (3613us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946392.567656:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1790946392.567695:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1790946392.567932:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff914685635500 x1877943303287808/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946392.567944:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914685635500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1877943303287808:0@lo:400: 00100000:10000000:3.0:1790946392.578052:0:7629:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1790946392.578454:0:7629:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1790946392.607257:0:7629:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1790946392.616769:0:7629:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1790946392.616801:0:7629:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1790946392.616944:0:7629:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1790946392.616974:0:7629:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1790946392.617462:0:7629:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1790946392.617475:0:7629:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1790946392.617484:0:7629:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x16e41aef93271b4e 00000020:01000004:3.0:1790946392.617492:0:7629:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1790946392.617578:0:7629:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.113@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1790946392.617582:0:7629:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.113@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1790946392.617587:0:7629:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1790946392.617608:0:7629:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1790946392.617611:0:7629:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.113@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1790946392.653749:0:7629:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.113@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790946392.653871:0:7629:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.113@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1790946392.653876:0:7629:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790946392.653877:0:7629:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790946392.653879:0:7629:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790946392.653880:0:7629:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790946392.653881:0:7629:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790946392.653882:0:7629:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790946392.653884:0:7629:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790946392.653885:0:7629:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790946392.653886:0:7629:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790946392.653888:0:7629:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790946392.653890:0:7629:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790946392.653893:0:7629:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1790946392.653896:0:7629:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790946392.653897:0:7629:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790946392.653899:0:7629:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790946392.653900:0:7629:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790946392.653901:0:7629:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790946392.653902:0:7629:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790946392.653903:0:7629:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790946392.653905:0:7629:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790946392.653906:0:7629:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790946392.653907:0:7629:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790946392.653908:0:7629:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790946392.653940:0:7629:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1790946392.653958:0:7629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914685635500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:7629:1877943303288192:0@lo:253: 00000100:00100000:2.0:1790946392.654038:0:7629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946392.654143:0:7629:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146c1c9f540 going to sleep for 11 seconds 00000100:00100000:0.0:1790946392.655064:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303288192 00000100:00100000:0.0:1790946392.655074:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303288192 00000100:00100000:0.0:1790946392.655130:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1790946392.655139:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682e33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+16:7629:x1877943303288192:12345-0@lo:253: 20000000:01000000:0.0:1790946392.655173:0:5829:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1790946392.655177:0:5829:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1790946392.655182:0:5829:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1790946392.655185:0:5829:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1790946392.657191:0:5829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790946392.657678:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1790946392.657693:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1790946392.657737:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1790946392.657744:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1790946392.657774:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1790946392.657907:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1790946392.661408:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1790946392.661439:0:5829:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.113@tcp 20000000:01000000:1.0:1790946392.661442:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.113@tcp (null) (null) (null) 00000040:00080000:1.0:1790946392.661479:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1790946392.661488:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1790946392.661540:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1790946392.661548:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.113@tcp (null) (null) 00000040:00080000:1.0:1790946392.661580:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1790946392.661589:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1790946392.661615:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1790946392.661663:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1790946392.662380:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1790946392.662397:0:5829:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.113@tcp 20000000:01000000:1.0:1790946392.662399:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.113@tcp (null) (null) (null) 00000040:00080000:1.0:1790946392.662433:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1790946392.662442:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1790946392.662474:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1790946392.662482:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.113@tcp (null) (null) 00000040:00080000:1.0:1790946392.662516:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1790946392.662524:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1790946392.662573:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1790946392.662610:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1790946392.662625:0:5829:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1790946392.662628:0:5829:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1790946392.662633:0:5829:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1790946392.662635:0:5829:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1790946392.662637:0:5829:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1790946392.662648:0:5829:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1790946392.662650:0:5829:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1790946392.662686:0:5829:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1790946392.662689:0:5829:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1790946392.665752:0:7631:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1790946392.665940:0:7631:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1790946392.665998:0:7631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1790946392.666580:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:2.0:1790946392.666626:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:2.0:1790946392.666661:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:2.0:1790946392.666676:0:5829:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1790946392.666678:0:5829:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1790946392.667807:0:7632:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1790946392.667881:0:7632:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1790946392.667938:0:7632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1790946392.670054:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1790946392.670104:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1790946392.670178:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1790946392.670192:0:5829:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1790946392.670194:0:5829:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1790946392.671416:0:7633:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1790946392.671723:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1790946392.671769:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1790946392.671964:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1790946392.671980:0:5829:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1790946392.671982:0:5829:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1790946392.675180:0:7634:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1790946392.675524:0:7634:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1790946392.675563:0:7634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1790946392.676135:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1790946392.676183:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1790946392.676422:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:0.0:1790946392.676445:0:5829:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1790946392.676466:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff914680030e00/0x16e41aef93271b55 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946392.676484:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff914680031a00/0x16e41aef93271aa6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93271a9f expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946392.676492:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff914680031600/0x16e41aef93271ad0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93271ac9 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946392.676499:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9146b1933a00/0x16e41aef93271afa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93271af3 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946392.676507:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9146c20cbc00/0x16e41aef93271b16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93271b0f expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946392.676514:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9146b1932800/0x16e41aef93271b40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93271b39 expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946392.676522:0:5829:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff914680030e00/0x16e41aef93271b55 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946392.676573:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9146b1932800/0x16e41aef93271b40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x16e41aef93271b39 expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946392.676588:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9146b1932800/0x16e41aef93271b40 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x16e41aef93271b39 expref: 16 pid: 5828 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946392.676602:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bdccaa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5829:1877943303288320:0@lo:104: 00000100:00100000:0.0:1790946392.676667:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790946392.676721:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9146c20cbc00/0x16e41aef93271b16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x16e41aef93271b0f expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946392.676729:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9146c20cbc00/0x16e41aef93271b16 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x16e41aef93271b0f expref: 16 pid: 5827 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946392.676737:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bdcc9c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5829:1877943303288448:0@lo:104: 00010000:00010000:0.0:1790946392.676874:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9146b1933a00/0x16e41aef93271afa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x16e41aef93271af3 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946392.676886:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9146b1933a00/0x16e41aef93271afa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x16e41aef93271af3 expref: 16 pid: 5829 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946392.676896:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bdcc8700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5829:1877943303288576:0@lo:104: 00010000:00010000:0.0:1790946392.676925:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff914680031600/0x16e41aef93271ad0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x16e41aef93271ac9 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946392.676933:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff914680031600/0x16e41aef93271ad0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x16e41aef93271ac9 expref: 16 pid: 5827 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946392.676941:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bdcc9880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5829:1877943303288704:0@lo:104: 00010000:00010000:0.0:1790946392.676974:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff914680031a00/0x16e41aef93271aa6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x16e41aef93271a9f expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946392.676982:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff914680031a00/0x16e41aef93271aa6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x16e41aef93271a9f expref: 16 pid: 5828 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946392.676990:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bdcc8e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5829:1877943303288832:0@lo:104: 00000100:00100000:0.0:1790946392.677079:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146b6571600 going to sleep for 11 seconds 00000100:00100000:2.0:1790946392.677142:0:5818:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1790946392.677163:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946392.677189:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946392.677232:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946392.677240:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946392.677249:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303288320 00000100:00100000:2.0:1790946392.677256:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303288320 00000100:00100000:2.0:1790946392.677287:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303288448 00000100:00100000:2.0:1790946392.677290:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303288448 00000100:00100000:2.0:1790946392.677301:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303288576 00000100:00100000:2.0:1790946392.677303:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303288576 00000100:00100000:2.0:1790946392.677311:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303288704 00000100:00100000:2.0:1790946392.677314:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303288704 00000100:00100000:2.0:1790946392.677322:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303288832 00000100:00100000:2.0:1790946392.677324:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303288832 00000100:00100000:2.0:1790946392.677338:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790946392.677346:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468494ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+7:5829:x1877943303288320:12345-0@lo:104: 00010000:00010000:2.0:1790946392.677357:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9146b180e600/0x16e41aef93271b39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93271b40 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946392.677416:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790946392.677423:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468494ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+7:5829:x1877943303288320:12345-0@lo:104: Request processed in 78us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946392.677430:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790946392.677471:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790946392.677478:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914685634e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+6:5829:x1877943303288448:12345-0@lo:104: 00010000:00010000:2.0:1790946392.677485:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9146b1932400/0x16e41aef93271b0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93271b16 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946392.677519:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790946392.677524:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914685634e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+6:5829:x1877943303288448:12345-0@lo:104: Request processed in 48us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946392.677529:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790946392.677541:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790946392.677547:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914685634700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+5:5829:x1877943303288576:12345-0@lo:104: 00010000:00010000:2.0:1790946392.677554:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9146c20ca200/0x16e41aef93271af3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93271afa expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946392.677579:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1790946392.677584:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914685634700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+5:5829:x1877943303288576:12345-0@lo:104: Request processed in 38us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946392.677589:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790946392.677599:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790946392.677605:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914685636680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+4:5829:x1877943303288704:12345-0@lo:104: 00010000:00010000:2.0:1790946392.677611:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9146b1933800/0x16e41aef93271ac9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93271ad0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946392.677643:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1790946392.677648:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914685636680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+4:5829:x1877943303288704:12345-0@lo:104: Request processed in 44us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946392.677654:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790946392.677666:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790946392.677671:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914685634380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+3:5829:x1877943303288832:12345-0@lo:104: 00010000:00010000:2.0:1790946392.677678:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9146b1933400/0x16e41aef93271a9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93271aa6 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946392.677702:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1790946392.677706:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914685634380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+3:5829:x1877943303288832:12345-0@lo:104: Request processed in 37us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946392.677712:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1790946392.677728:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1790946392.677733:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9146b180e600/0x16e41aef93271b39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93271b40 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946392.677739:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180e600 already unused, calling callback (ffffffffc1d96c20) 10000000:00010000:2.0:1790946392.677743:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9146b180e600/0x16e41aef93271b39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x16e41aef93271b40 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946392.677752:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9146b180e600/0x16e41aef93271b39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x16e41aef93271b40 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790946392.677759:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9146b180e600/0x16e41aef93271b39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x16e41aef93271b40 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790946392.677766:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790946392.678020:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9146b180e600/0x16e41aef93271b39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271b40 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946392.678028:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790946392.678046:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9146b180e600/0x16e41aef93271b39 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271b40 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946392.678053:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9146b180e600/0x16e41aef93271b39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271b40 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946392.678066:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1790946392.678069:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9146b1932400/0x16e41aef93271b0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93271b16 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946392.678074:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1932400 already unused, calling callback (ffffffffc1d96c20) 10000000:00010000:2.0:1790946392.678077:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9146b1932400/0x16e41aef93271b0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x16e41aef93271b16 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946392.678084:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9146b1932400/0x16e41aef93271b0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x16e41aef93271b16 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790946392.678091:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9146b1932400/0x16e41aef93271b0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x16e41aef93271b16 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790946392.678096:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790946392.678106:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9146b1932400/0x16e41aef93271b0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271b16 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946392.678111:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790946392.678116:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9146b1932400/0x16e41aef93271b0f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271b16 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946392.678134:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9146b1932400/0x16e41aef93271b0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271b16 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946392.678146:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790946392.678149:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9146c20ca200/0x16e41aef93271af3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93271afa expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946392.678155:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146c20ca200 already unused, calling callback (ffffffffc1d96c20) 10000000:00010000:2.0:1790946392.678157:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9146c20ca200/0x16e41aef93271af3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x16e41aef93271afa expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946392.678164:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9146c20ca200/0x16e41aef93271af3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x16e41aef93271afa expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790946392.678170:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9146c20ca200/0x16e41aef93271af3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x16e41aef93271afa expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790946392.678176:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790946392.678189:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9146c20ca200/0x16e41aef93271af3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271afa expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946392.678195:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790946392.678229:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9146c20ca200/0x16e41aef93271af3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271afa expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946392.678236:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9146c20ca200/0x16e41aef93271af3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271afa expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946392.678247:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790946392.678256:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9146b1933800/0x16e41aef93271ac9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93271ad0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946392.678263:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1933800 already unused, calling callback (ffffffffc1d96c20) 10000000:00010000:2.0:1790946392.678266:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9146b1933800/0x16e41aef93271ac9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x16e41aef93271ad0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946392.678272:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9146b1933800/0x16e41aef93271ac9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x16e41aef93271ad0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790946392.678278:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9146b1933800/0x16e41aef93271ac9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x16e41aef93271ad0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790946392.678284:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790946392.678298:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9146b1933800/0x16e41aef93271ac9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271ad0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946392.678303:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790946392.678308:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9146b1933800/0x16e41aef93271ac9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271ad0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946392.678315:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9146b1933800/0x16e41aef93271ac9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271ad0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946392.678326:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946392.678329:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9146b1933400/0x16e41aef93271a9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93271aa6 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946392.678335:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1933400 already unused, calling callback (ffffffffc1d96c20) 10000000:00010000:2.0:1790946392.678338:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9146b1933400/0x16e41aef93271a9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x16e41aef93271aa6 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946392.678356:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9146b1933400/0x16e41aef93271a9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x16e41aef93271aa6 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790946392.678363:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9146b1933400/0x16e41aef93271a9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x16e41aef93271aa6 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790946392.678369:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790946392.678383:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9146b1933400/0x16e41aef93271a9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271aa6 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946392.678389:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790946392.678394:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9146b1933400/0x16e41aef93271a9f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271aa6 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946392.678401:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9146b1933400/0x16e41aef93271a9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271aa6 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946392.678416:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946392.678418:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946392.678420:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946392.678433:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914685635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3302:1877943303288960:0@lo:103: 00000100:00100000:2.0:1790946392.678471:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946392.678501:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914685637100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3302:1877943303289472:0@lo:103: 00000100:00100000:2.0:1790946392.678533:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946392.678558:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790946392.678564:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914685637800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3302:1877943303289088:0@lo:103: 00000100:00100000:2.0:1790946392.678586:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946392.678613:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914685636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3300:1877943303289216:0@lo:103: 00000100:00100000:2.0:1790946392.678643:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946392.678656:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790946392.678660:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914685637b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3300:1877943303289344:0@lo:103: 00000100:00100000:2.0:1790946392.678677:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946392.678698:0:5821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303288960 00000100:00100000:2.0:1790946392.678702:0:5821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303288960 00010000:00010000:2.0:1790946392.678720:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9146b1932800/0x16e41aef93271b40 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef93271b39 expref: 17 pid: 5828 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946392.678735:0:5821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303289472 00000100:00100000:2.0:1790946392.678737:0:5821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303289472 00010000:00010000:2.0:1790946392.678747:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff914680031a00/0x16e41aef93271aa6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef93271a9f expref: 18 pid: 5828 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946392.678756:0:5821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303289088 00000100:00100000:2.0:1790946392.678759:0:5821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303289088 00010000:00010000:2.0:1790946392.678769:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9146c20cbc00/0x16e41aef93271b16 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef93271b0f expref: 19 pid: 5827 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946392.679143:0:5819:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303289216 00000100:00100000:0.0:1790946392.679148:0:5819:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303289216 00010000:00010000:0.0:1790946392.679165:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9146b1933a00/0x16e41aef93271afa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef93271af3 expref: 20 pid: 5829 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946392.679179:0:5819:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303289344 00000100:00100000:0.0:1790946392.679182:0:5819:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303289344 00010000:00010000:0.0:1790946392.679193:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff914680031600/0x16e41aef93271ad0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef93271ac9 expref: 21 pid: 5827 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946392.679234:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790946392.679241:0:5819:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914685635c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+21:3302:x1877943303288960:12345-0@lo:103: 00010000:00010000:0.0:1790946392.679252:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790946392.679257:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9146b1932800/0x16e41aef93271b40 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef93271b39 expref: 21 pid: 5828 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946392.679267:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9146b1932800/0x16e41aef93271b40 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x16e41aef93271b39 expref: 21 pid: 5828 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946392.679282:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790946392.679321:0:5819:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914685635c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+21:3302:x1877943303288960:12345-0@lo:103: Request processed in 81us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946392.679337:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790946392.679353:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790946392.679359:0:5819:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+20:3302:x1877943303289472:12345-0@lo:103: 00010000:00010000:0.0:1790946392.679367:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790946392.679371:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff914680031a00/0x16e41aef93271aa6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef93271a9f expref: 20 pid: 5828 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946392.679380:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff914680031a00/0x16e41aef93271aa6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x16e41aef93271a9f expref: 20 pid: 5828 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946392.679388:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790946392.679411:0:5819:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+20:3302:x1877943303289472:12345-0@lo:103: Request processed in 53us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946392.679417:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790946392.679430:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790946392.679436:0:5819:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3302:x1877943303289088:12345-0@lo:103: 00010000:00010000:0.0:1790946392.679443:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790946392.679447:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9146c20cbc00/0x16e41aef93271b16 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef93271b0f expref: 19 pid: 5827 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946392.679455:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9146c20cbc00/0x16e41aef93271b16 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x16e41aef93271b0f expref: 19 pid: 5827 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946392.679464:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790946392.679485:0:5819:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3302:x1877943303289088:12345-0@lo:103: Request processed in 50us (899us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946392.679491:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790946392.679503:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790946392.679514:0:5819:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+18:3300:x1877943303289216:12345-0@lo:103: 00010000:00010000:0.0:1790946392.679531:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790946392.679536:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9146b1933a00/0x16e41aef93271afa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef93271af3 expref: 18 pid: 5829 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946392.679545:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9146b1933a00/0x16e41aef93271afa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x16e41aef93271af3 expref: 18 pid: 5829 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946392.679555:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790946392.679583:0:5819:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+18:3300:x1877943303289216:12345-0@lo:103: Request processed in 69us (939us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946392.679590:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790946392.679603:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790946392.679609:0:5819:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee38700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+17:3300:x1877943303289344:12345-0@lo:103: 00010000:00010000:0.0:1790946392.679617:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790946392.679621:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff914680031600/0x16e41aef93271ad0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef93271ac9 expref: 17 pid: 5827 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946392.679629:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff914680031600/0x16e41aef93271ad0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x16e41aef93271ac9 expref: 17 pid: 5827 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946392.679641:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff914680030e00/0x16e41aef93271b55 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946392.679648:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff914680030e00/0x16e41aef93271b55 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946392.679663:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff914680030e00/0x16e41aef93271b55 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946392.679680:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff914680030e00/0x16e41aef93271b55 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946392.679687:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff914680030e00/0x16e41aef93271b55 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946392.679694:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff914680030e00/0x16e41aef93271b55 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946392.679699:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914680030e00 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:0.0:1790946392.679703:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff914680030e00/0x16e41aef93271b55 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946392.679712:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff914680030e00/0x16e41aef93271b55 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946392.679720:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff914680030e00/0x16e41aef93271b55 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946392.679731:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790946392.679755:0:5819:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee38700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+17:3300:x1877943303289344:12345-0@lo:103: Request processed in 146us (1077us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946392.679760:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1790946392.679818:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9146b1932800/0x16e41aef93271b40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x16e41aef93271b39 expref: 16 pid: 5828 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946392.679832:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bdccaa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5829:1877943303288320:0@lo:104: 00010000:00010000:0.0:1790946392.679852:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9146c20cbc00/0x16e41aef93271b16 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x16e41aef93271b0f expref: 15 pid: 5827 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946392.679875:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bdcc9c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5829:1877943303288448:0@lo:104: 00010000:00010000:0.0:1790946392.679888:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9146b1933a00/0x16e41aef93271afa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x16e41aef93271af3 expref: 14 pid: 5829 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946392.679897:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bdcc8700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5829:1877943303288576:0@lo:104: 00010000:00010000:0.0:1790946392.679905:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff914680031600/0x16e41aef93271ad0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x16e41aef93271ac9 expref: 13 pid: 5827 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946392.679915:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bdcc9880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5829:1877943303288704:0@lo:104: 00010000:00010000:0.0:1790946392.679923:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff914680031a00/0x16e41aef93271aa6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x16e41aef93271a9f expref: 12 pid: 5828 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946392.679944:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bdcc8e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5829:1877943303288832:0@lo:104: 00010000:00010000:0.0:1790946392.679967:0:5829:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff914680030e00/0x16e41aef93271b55 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946392.679976:0:5829:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff914680030e00/0x16e41aef93271b55 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946392.679981:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff914680030e00/0x16e41aef93271b55 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946392.679986:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff914680030e00/0x16e41aef93271b55 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790946392.679998:0:5829:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1790946392.680128:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914685637800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3302:1877943303289088:0@lo:103: 00000100:00100000:1.0:1790946392.680138:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914685635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3302:1877943303288960:0@lo:103: 00000100:00100000:1.0:1790946392.680145:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914685637100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3302:1877943303289472:0@lo:103: 00000100:00100000:2.0:1790946392.680331:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914685637b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3300:1877943303289344:0@lo:103: 00000100:00100000:2.0:1790946392.680339:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914685636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3300:1877943303289216:0@lo:103: 00010000:00010000:3.0:1790946392.680416:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946392.738586:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682e33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+11:7629:x1877943303288192:12345-0@lo:253: Request processed in 83441us (84540us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946392.738600:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1790946392.738741:0:7629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914685635500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:7629:1877943303288192:0@lo:253: 10000000:01000000:3.0:1790946392.738755:0:7629:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1790946392.738771:0:7629:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790946392.738773:0:7629:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790946392.738774:0:7629:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790946392.738775:0:7629:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1790946392.738777:0:7629:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790946392.738788:0:7629:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790946392.738790:0:7629:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790946392.738791:0:7629:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1790946392.738793:0:7629:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790946392.738794:0:7629:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1790946392.738818:0:7629:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9145853b6000 from lustre-OST0001 10000000:01000000:3.0:1790946392.738851:0:7629:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1790946392.738854:0:7629:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1790946392.738861:0:7629:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff914682e5b380 local copy 10000000:01000000:3.0:1790946392.738865:0:7629:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1790946392.738902:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146a032bc00/0x16e41aef93271b5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946392.738913:0:7629:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.113@tcp lock: ffff9146a032bc00/0x16e41aef93271b5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946392.738921:0:7629:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9146a032bc00/0x16e41aef93271b5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946392.738937:0:7629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914682eac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:7629:1877943303289600:0@lo:101: 00000100:00100000:3.0:1790946392.738972:0:7629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946392.739023:0:7629:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146c1c9f540 going to sleep for 11 seconds 00000100:00100000:1.0:1790946392.739371:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303289600 00000100:00100000:1.0:1790946392.739379:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303289600 00000100:00100000:1.0:1790946392.739425:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1790946392.739434:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682e32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+11:7629:x1877943303289600:12345-0@lo:101: 00010000:00010000:1.0:1790946392.739447:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946392.739461:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9146b180fe00/0x16e41aef93271b63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x16e41aef93271b5c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946392.739482:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9146b180fe00/0x16e41aef93271b63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x16e41aef93271b5c expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946392.739492:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9146b180fe00/0x16e41aef93271b63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93271b5c expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946392.739518:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b180fe00, rc 0) 00000100:00100000:1.0:1790946392.739556:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682e32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+12:7629:x1877943303289600:12345-0@lo:101: Request processed in 124us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946392.739562:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790946392.739727:0:7629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914682eac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:7629:1877943303289600:0@lo:101: 00010000:00010000:3.0:1790946392.739741:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9146a032bc00/0x16e41aef93271b5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x16e41aef93271b63 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946392.739751:0:7629:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9146a032bc00/0x16e41aef93271b5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x16e41aef93271b63 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946392.739863:0:7629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914682eac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:7629:1877943303289728:0@lo:501: 00000100:00100000:3.0:1790946392.739889:0:7629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946392.739917:0:7629:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146c1c9f540 going to sleep for 11 seconds 00000100:00100000:1.0:1790946392.739971:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303289728 00000100:00100000:1.0:1790946392.739976:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303289728 00000100:00100000:1.0:1790946392.740006:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790946392.740014:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+12:7629:x1877943303289728:12345-0@lo:501: 00000100:00100000:1.0:1790946392.740352:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+12:7629:x1877943303289728:12345-0@lo:501: Request processed in 338us (461us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790946392.740360:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1790946392.740582:0:7629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914682eac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:7629:1877943303289728:0@lo:501: 10000000:01000000:3.0:1790946392.740596:0:7629:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.113@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1790946392.740624:0:7629:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.113@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1790946392.740630:0:7629:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146a032bc00/0x16e41aef93271b5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x16e41aef93271b63 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946392.740639:0:7629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146a032bc00/0x16e41aef93271b5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x16e41aef93271b63 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946392.740647:0:7629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff9146a032bc00/0x16e41aef93271b5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x16e41aef93271b63 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946392.740707:0:7629:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1790946392.740729:0:7629:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9145853b6000 10000000:01000000:3.0:1790946392.740735:0:7629:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1790946392.740740:0:7629:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1790946392.740742:0:7629:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790946392.740747:0:7629:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1790946392.740750:0:7629:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1790946392.740767:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146a032ae00/0x16e41aef93271b6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946392.740776:0:7629:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9146a032ae00/0x16e41aef93271b6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946392.740798:0:7629:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9146a032ae00/0x16e41aef93271b6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946392.740811:0:7629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914682eac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:7629:1877943303289856:0@lo:101: 00000100:00100000:3.0:1790946392.740853:0:7629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946392.740882:0:7629:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146c1c9ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1790946392.740942:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303289856 00000100:00100000:0.0:1790946392.740947:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303289856 00000100:00100000:0.0:1790946392.740990:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1790946392.740998:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+12:7629:x1877943303289856:12345-0@lo:101: 00010000:00010000:0.0:1790946392.741009:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946392.741020:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff914680030e00/0x16e41aef93271b71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x16e41aef93271b6a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946392.741039:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff914680030e00/0x16e41aef93271b71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x16e41aef93271b6a expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946392.741049:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff914680030e00/0x16e41aef93271b71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93271b6a expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946392.741057:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914680030e00, rc 0) 00000100:00100000:0.0:1790946392.741098:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+13:7629:x1877943303289856:12345-0@lo:101: Request processed in 102us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946392.741105:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790946392.741185:0:7629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914682eac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:7629:1877943303289856:0@lo:101: 00010000:00010000:3.0:1790946392.741197:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9146a032ae00/0x16e41aef93271b6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271b71 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946392.741304:0:7629:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9146a032ae00/0x16e41aef93271b6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93271b71 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946392.741364:0:7629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914682eac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:7629:1877943303289984:0@lo:501: 00000100:00100000:3.0:1790946392.741408:0:7629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946392.741427:0:7629:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146c1c9ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1790946392.741489:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303289984 00000100:00100000:0.0:1790946392.741494:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303289984 00000100:00100000:0.0:1790946392.741538:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1790946392.741545:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+13:7629:x1877943303289984:12345-0@lo:501: 00000100:00100000:0.0:1790946392.741737:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+13:7629:x1877943303289984:12345-0@lo:501: Request processed in 191us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946392.741745:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790946392.741901:0:7629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914682eac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:7629:1877943303289984:0@lo:501: 00000100:00100000:3.0:1790946392.741932:0:7629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914682eac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:7629:1877943303290112:0@lo:503: 00000100:00100000:3.0:1790946392.741975:0:7629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946392.741997:0:7629:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146c1c9ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1790946392.742061:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303290112 00000100:00100000:1.0:1790946392.742066:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303290112 00000100:00100000:1.0:1790946392.742096:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1790946392.742104:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+13:7629:x1877943303290112:12345-0@lo:503: 00000100:00100000:1.0:1790946392.742687:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+13:7629:x1877943303290112:12345-0@lo:503: Request processed in 582us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946392.742695:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790946392.742825:0:7629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914682eac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:7629:1877943303290112:0@lo:503: 00000040:00080000:3.0:1790946392.743103:0:7629:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790946392.743169:0:7629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914682eac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:7629:1877943303290240:0@lo:502: 00000100:00100000:3.0:1790946392.743329:0:7629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946392.743357:0:7629:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146a19bf240 going to sleep for 11 seconds 00000100:00100000:0.0:1790946392.743425:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303290240 00000100:00100000:0.0:1790946392.743430:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303290240 00000100:00100000:0.0:1790946392.743468:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1790946392.743477:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+13:7629:x1877943303290240:12345-0@lo:502: 00000100:00100000:0.0:1790946392.743724:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+13:7629:x1877943303290240:12345-0@lo:502: Request processed in 248us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946392.743737:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790946392.743878:0:7629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914682eac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:7629:1877943303290240:0@lo:502: 00000040:00080000:3.0:1790946392.744154:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1790946392.744324:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1790946392.744370:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1790946392.744426:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1790946392.744468:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1790946392.744613:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1790946392.744646:0:7629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914682eac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:7629:1877943303290368:0@lo:502: 00000100:00100000:3.0:1790946392.744692:0:7629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946392.744773:0:7629:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146c1c9ff00 going to sleep for 11 seconds 00010000:00010000:2.0:1790946392.744858:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946392.744866:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9146a032bc00/0x16e41aef93271b5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x16e41aef93271b63 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946392.744877:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146a032bc00 already unused, calling callback (ffffffffc1d96c20) 10000000:00010000:2.0:1790946392.744882:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9146a032bc00/0x16e41aef93271b5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x16e41aef93271b63 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946392.744892:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9146a032bc00/0x16e41aef93271b5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x16e41aef93271b63 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790946392.744907:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9146a032bc00/0x16e41aef93271b5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x16e41aef93271b63 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790946392.744913:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790946392.744936:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9146a032bc00/0x16e41aef93271b5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x16e41aef93271b63 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946392.744943:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790946392.744974:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9146a032bc00/0x16e41aef93271b5c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x16e41aef93271b63 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946392.744982:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9146a032bc00/0x16e41aef93271b5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x16e41aef93271b63 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946392.744995:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946392.744997:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946392.744999:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946392.745047:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3303:1877943303290496:0@lo:103: 00000100:00100000:3.0:1790946392.745076:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946392.745194:0:5819:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303290496 00000100:00100000:2.0:1790946392.745313:0:5819:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303290496 00000100:00100000:2.0:1790946392.745365:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790946392.745374:0:5819:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682eac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+13:3303:x1877943303290496:12345-0@lo:103: 00010000:00010000:2.0:1790946392.745386:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790946392.745401:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9146b180fe00/0x16e41aef93271b63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x16e41aef93271b5c expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946392.745415:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790946392.745451:0:5819:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682eac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+12:3303:x1877943303290496:12345-0@lo:103: Request processed in 78us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946392.745457:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790946392.745638:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3303:1877943303290496:0@lo:103: 00000100:00100000:0.0:1790946392.745712:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303290368 00000100:00100000:0.0:1790946392.745717:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303290368 00000100:00100000:0.0:1790946392.745787:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1790946392.745795:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+12:7629:x1877943303290368:12345-0@lo:502: 00000100:00100000:0.0:1790946392.749061:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+12:7629:x1877943303290368:12345-0@lo:502: Request processed in 3257us (4359us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946392.749076:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790946392.751460:0:7629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914682eac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:7629:1877943303290368:0@lo:502: 00000040:00080000:1.0:1790946392.751679:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1790946392.751696:0:7629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1790946392.753120:0:7636:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790946392.753130:0:7636:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1790946392.753137:0:7636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790946392.753140:0:7636:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1790946392.753147:0:7636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790946392.753173:0:7636:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9146c1ca4d40) 00000020:00000080:1.0:1790946392.753383:0:7636:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1790946392.753393:0:7636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1790946392.753455:0:7636:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9145853b6000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1790946392.753463:0:7636:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1790946392.753469:0:7636:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x16e41aef93271b7f 00010000:00010000:1.0:1790946392.763950:0:7636:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1790946392.764480:0:7636:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1790946392.768043:0:7636:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1790946392.768780:0:7636:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1790946392.773755:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1790946392.774629:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1790946392.776637:0:7636:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1790946392.776648:0:7636:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790946392.776654:0:7636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946392.776656:0:7636:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1790946392.776661:0:7636:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790946392.776665:0:7636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946392.776666:0:7636:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790946392.776669:0:7636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790946392.776671:0:7636:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1790946392.776724:0:7636:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790946392.776728:0:7636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946392.776729:0:7636:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:2.0:1790946392.776732:0:7636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1790946392.776891:0:7629:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1790946392.776917:0:7629:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1790946392.776941:0:7629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146a032ae00/0x16e41aef93271b6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271b71 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946392.776954:0:7629:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9146a032ae00/0x16e41aef93271b6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271b71 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790946392.776964:0:7629:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9145853b6000 from 1 10000000:01000000:1.0:1790946392.776967:0:7629:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790946392.777005:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146b180f800/0x16e41aef93271b86 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946392.777014:0:7629:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9146b180f800/0x16e41aef93271b86 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946392.777026:0:7629:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9146b180f800/0x16e41aef93271b86 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946392.777048:0:7629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b68aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:7629:1877943303290624:0@lo:101: 00000100:00100000:1.0:1790946392.777108:0:7629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946392.777147:0:7629:0:(client.c:2716:ptlrpc_set_wait()) set ffff914684855840 going to sleep for 11 seconds 00000100:00100000:0.0:1790946392.777247:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303290624 00000100:00100000:0.0:1790946392.777255:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303290624 00000100:00100000:0.0:1790946392.777293:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1790946392.777301:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+12:7629:x1877943303290624:12345-0@lo:101: 00010000:00010000:0.0:1790946392.777313:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946392.777326:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff914680031a00/0x16e41aef93271b8d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x16e41aef93271b86 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946392.777346:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff914680031a00/0x16e41aef93271b8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x16e41aef93271b86 expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946392.777357:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff914680031a00/0x16e41aef93271b8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93271b86 expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946392.777365:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914680031a00, rc 0) 00000100:00100000:0.0:1790946392.777400:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+13:7629:x1877943303290624:12345-0@lo:101: Request processed in 100us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946392.777406:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1790946392.777448:0:7629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b68aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:7629:1877943303290624:0@lo:101: 00010000:00010000:0.0:1790946392.777468:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9146b180f800/0x16e41aef93271b86 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271b8d expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946392.777477:0:7629:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9146b180f800/0x16e41aef93271b86 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93271b8d expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946392.777557:0:7629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bdcc8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:7629:1877943303290752:0@lo:501: 00000100:00100000:0.0:1790946392.777579:0:7629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946392.777591:0:7629:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146b6571480 going to sleep for 11 seconds 00000100:00100000:0.0:1790946392.777603:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303290752 00000100:00100000:0.0:1790946392.777607:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303290752 00000100:00100000:0.0:1790946392.777623:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1790946392.777628:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+13:7629:x1877943303290752:12345-0@lo:501: 00000100:00100000:0.0:1790946392.777821:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+13:7629:x1877943303290752:12345-0@lo:501: Request processed in 191us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946392.777828:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1790946392.777872:0:7629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bdcc8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:7629:1877943303290752:0@lo:501: 00000100:00100000:0.0:1790946392.777899:0:7629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bdcc8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:7629:1877943303290880:0@lo:503: 00000100:00100000:0.0:1790946392.777935:0:7629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946392.777948:0:7629:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146b6571480 going to sleep for 11 seconds 00000100:00100000:0.0:1790946392.777960:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303290880 00000100:00100000:0.0:1790946392.777964:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303290880 00000100:00100000:0.0:1790946392.777983:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1790946392.777990:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+13:7629:x1877943303290880:12345-0@lo:503: 00000100:00100000:0.0:1790946392.778280:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+13:7629:x1877943303290880:12345-0@lo:503: Request processed in 290us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946392.778287:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1790946392.778332:0:7629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bdcc8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:7629:1877943303290880:0@lo:503: 00000040:00080000:0.0:1790946392.778616:0:7629:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790946392.778670:0:7629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bdcc8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:7629:1877943303291008:0@lo:502: 00000100:00100000:0.0:1790946392.778707:0:7629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946392.778722:0:7629:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146b6571480 going to sleep for 11 seconds 00000100:00100000:0.0:1790946392.778737:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303291008 00000100:00100000:0.0:1790946392.778742:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303291008 00000100:00100000:0.0:1790946392.778765:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1790946392.778770:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+13:7629:x1877943303291008:12345-0@lo:502: 00000100:00100000:0.0:1790946392.778923:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+13:7629:x1877943303291008:12345-0@lo:502: Request processed in 151us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946392.778929:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1790946392.778967:0:7629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bdcc8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:7629:1877943303291008:0@lo:502: 00000040:00080000:0.0:1790946392.779174:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1790946392.779239:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1790946392.779262:0:7629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bdcc8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:7629:1877943303291136:0@lo:502: 00000100:00100000:0.0:1790946392.779294:0:7629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946392.779309:0:7629:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146b6571480 going to sleep for 11 seconds 00000100:00100000:0.0:1790946392.779323:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303291136 00000100:00100000:0.0:1790946392.779327:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303291136 00000100:00100000:0.0:1790946392.779351:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1790946392.779356:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+13:7629:x1877943303291136:12345-0@lo:502: 00000100:00100000:0.0:1790946392.779458:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+13:7629:x1877943303291136:12345-0@lo:502: Request processed in 101us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946392.779464:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1790946392.779503:0:7629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bdcc8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:7629:1877943303291136:0@lo:502: 00000040:00080000:0.0:1790946392.779574:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1790946392.779582:0:7629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1790946392.779877:0:7639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790946392.779885:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790946392.779887:0:7639:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1790946392.779894:0:7639:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9145853b6000 00000020:00000080:0.0:1790946392.779896:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790946392.779912:0:7639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790946392.779915:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790946392.779916:0:7639:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1790946392.779919:0:7639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1790946392.779947:0:7629:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1790946392.779969:0:7629:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790946392.779978:0:7629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146b180f800/0x16e41aef93271b86 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271b8d expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946392.779989:0:7629:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9146b180f800/0x16e41aef93271b86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271b8d expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790946392.780027:0:7629:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1790946392.780030:0:7629:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9145853b6000 10000000:01000000:0.0:1790946392.780033:0:7629:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9145853b6000 10000000:01000000:0.0:1790946392.780037:0:7629:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790946392.780042:0:7629:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9145853b6000 from 1 10000000:01000000:0.0:1790946392.780045:0:7629:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790946392.780066:0:7629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff914680031600/0x16e41aef93271b94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946392.780074:0:7629:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff914680031600/0x16e41aef93271b94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946392.780093:0:7629:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff914680031600/0x16e41aef93271b94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946392.780105:0:7629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bdcc8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:7629:1877943303291264:0@lo:101: 00000100:00100000:0.0:1790946392.780137:0:7629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946392.780152:0:7629:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146b6571c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790946392.780166:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303291264 00000100:00100000:0.0:1790946392.780171:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303291264 00000100:00100000:0.0:1790946392.780194:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1790946392.780222:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+13:7629:x1877943303291264:12345-0@lo:101: 00010000:00010000:0.0:1790946392.780233:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946392.780245:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff914680031c00/0x16e41aef93271b9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x16e41aef93271b94 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946392.780265:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff914680031c00/0x16e41aef93271b9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x16e41aef93271b94 expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946392.780274:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff914680031c00/0x16e41aef93271b9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93271b94 expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946392.780282:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914680031c00, rc 0) 00000100:00100000:0.0:1790946392.780311:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+14:7629:x1877943303291264:12345-0@lo:101: Request processed in 111us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946392.780316:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1790946392.780349:0:7629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bdcc8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:7629:1877943303291264:0@lo:101: 00010000:00010000:0.0:1790946392.780359:0:7629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff914680031600/0x16e41aef93271b94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271b9b expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946392.780376:0:7629:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff914680031600/0x16e41aef93271b94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93271b9b expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946392.780428:0:7629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bdcc8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:7629:1877943303291392:0@lo:501: 00000100:00100000:0.0:1790946392.780449:0:7629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946392.780461:0:7629:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146b6571c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790946392.780473:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303291392 00000100:00100000:0.0:1790946392.780476:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303291392 00000100:00100000:0.0:1790946392.780497:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1790946392.780502:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+14:7629:x1877943303291392:12345-0@lo:501: 00000100:00100000:0.0:1790946392.780669:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+14:7629:x1877943303291392:12345-0@lo:501: Request processed in 165us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946392.780675:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1790946392.780703:0:7629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bdcc8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:7629:1877943303291392:0@lo:501: 00000100:00100000:0.0:1790946392.780725:0:7629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bdcc8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:7629:1877943303291520:0@lo:503: 00000100:00100000:0.0:1790946392.780754:0:7629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946392.780765:0:7629:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146b6571c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790946392.780776:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303291520 00000100:00100000:0.0:1790946392.780778:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303291520 00000100:00100000:0.0:1790946392.780796:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1790946392.780801:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+14:7629:x1877943303291520:12345-0@lo:503: 00000100:00100000:0.0:1790946392.782694:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+14:7629:x1877943303291520:12345-0@lo:503: Request processed in 1885us (1932us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946392.782706:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1790946392.783445:0:7629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bdcc8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:7629:1877943303291520:0@lo:503: 00000040:00080000:0.0:1790946392.787806:0:7629:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790946392.787929:0:7629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bdcc9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:7629:1877943303291648:0@lo:502: 00000100:00100000:0.0:1790946392.788013:0:7629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946392.788093:0:7629:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146b65716c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790946392.790469:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303291648 00000100:00100000:1.0:1790946392.790482:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303291648 00000100:00100000:0.0:1790946392.791692:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1790946392.791703:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+14:7629:x1877943303291648:12345-0@lo:502: 00000100:00100000:0.0:1790946392.791981:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+14:7629:x1877943303291648:12345-0@lo:502: Request processed in 279us (3968us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946392.791989:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1790946392.792065:0:7629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bdcc9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:7629:1877943303291648:0@lo:502: 00000040:00080000:1.0:1790946392.792376:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1790946392.792420:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1790946392.792447:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1790946392.792512:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1790946392.792547:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1790946392.792586:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1790946392.792614:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1790946392.792651:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1790946392.792687:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1790946392.792715:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1790946392.792740:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1790946392.792775:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1790946392.792802:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1790946392.792827:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1790946392.792895:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1790946392.792935:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1790946392.792971:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1790946392.793020:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1790946392.793055:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1790946392.793089:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1790946392.793134:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1790946392.793172:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1790946392.793233:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1790946392.793306:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1790946392.793345:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1790946392.793380:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1790946392.793428:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1790946392.793476:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1790946392.793506:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1790946392.793556:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1790946392.793593:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1790946392.793626:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1790946392.793659:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1790946392.793707:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:1.0:1790946392.793740:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:1.0:1790946392.793783:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:1.0:1790946392.793815:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:1.0:1790946392.793868:0:7629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b68a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:7629:1877943303291776:0@lo:502: 00000100:00100000:1.0:1790946392.793932:0:7629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946392.794639:0:7629:0:(client.c:2716:ptlrpc_set_wait()) set ffff914684855300 going to sleep for 11 seconds 00000100:00100000:2.0:1790946392.794685:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303291776 00000100:00100000:2.0:1790946392.794693:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303291776 00000100:00100000:2.0:1790946392.794739:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1790946392.794749:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+14:7629:x1877943303291776:12345-0@lo:502: 00000100:00100000:2.0:1790946392.795054:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+14:7629:x1877943303291776:12345-0@lo:502: Request processed in 305us (1121us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946392.795062:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1790946392.795143:0:7629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b68a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:7629:1877943303291776:0@lo:502: 00000040:00080000:2.0:1790946392.795696:0:7629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:2.0:1790946392.795709:0:7629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1790946392.796824:0:7641:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1790946392.796850:0:7641:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9146849dcd40) 00000020:00000080:0.0:1790946392.796875:0:7641:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1790946392.796963:0:7641:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9145853b6000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1790946392.796968:0:7641:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9145853b6000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1790946392.796970:0:7641:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9145853b6000 3 00010000:00080000:0.0:1790946392.796999:0:7641:0:(ldlm_lib.c:102:import_set_conn()) imp ffff914586829800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.113@tcp at head 00010000:00010000:0.0:1790946392.799118:0:7641:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:0.0:1790946392.799665:0:7641:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1790946392.799704:0:7641:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1790946392.799716:0:7641:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x16e41aef93271ba9 00000100:00080000:0.0:1790946392.799725:0:7641:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790946392.799736:0:7641:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff914586829800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:0.0:1790946392.799771:0:7641:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9146bdcc8700 x1877943303291904/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790946392.799799:0:7641:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1790946392.799880:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bdcc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1877943303291904:0@lo:38: 00000100:00100000:3.0:1790946392.799947:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946392.800178:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303291904 00000100:00100000:0.0:1790946392.800187:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303291904 00000100:00100000:0.0:1790946392.800248:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790946392.800255:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682eac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3299:x1877943303291904:12345-0@lo:38: 00010000:00080000:0.0:1790946392.800285:0:5835:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 177 last 0 00000020:00000080:0.0:1790946392.800324:0:5835:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x16e41aef93271bb0 00000004:00100000:0.0:1790946392.800339:0:5835:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790946392.800369:0:5835:0:(import.c:65:import_set_state_nolock()) ffff91458682a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790946392.800426:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682eac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1877943303291904:12345-0@lo:38: Request processed in 170us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946392.800433:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000040:00080000:0.0:1790946392.800569:0:7641:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00010000:00080000:2.0:1790946392.801096:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9146bdcc8700 x1877943303291904/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790946402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946392.801108:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790946392.801117:0:3299:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1790946392.801123:0:3299:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1790946392.801135:0:3299:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1790946392.801138:0:3299:0:(import.c:65:import_set_state_nolock()) ffff914586829800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790946392.801145:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bdcc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1877943303291904:0@lo:38: 00000020:01000000:2.0:1790946392.801173:0:7629:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 00000100:00100000:3.0:1790946392.801398:0:7642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914682eadc00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7642:1877943303292032:0@lo:901: 00000100:00100000:3.0:1790946392.801442:0:7642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:2.0:1790946392.801524:0:7629:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790946392.801540:0:7629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff914680031600/0x16e41aef93271b94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271b9b expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946392.801552:0:7629:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff914680031600/0x16e41aef93271b94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271b9b expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1790946392.801611:0:7629:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1790946392.801614:0:7629:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790946392.801615:0:7629:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790946392.801616:0:7629:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790946392.801617:0:7629:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790946392.801619:0:7629:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790946392.801620:0:7629:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790946392.801621:0:7629:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790946392.801622:0:7629:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790946392.801624:0:7629:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790946392.801625:0:7629:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790946392.801628:0:7629:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1790946392.801631:0:7629:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790946392.801632:0:7629:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790946392.801633:0:7629:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790946392.801634:0:7629:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790946392.801635:0:7629:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790946392.801636:0:7629:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790946392.801637:0:7629:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790946392.801638:0:7629:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790946392.801639:0:7629:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790946392.801640:0:7629:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790946392.801641:0:7629:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790946392.801653:0:7629:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1790946392.801666:0:7629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee38380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:7629:1877943303292160:0@lo:253: 00000100:00100000:2.0:1790946392.801703:0:7629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946392.801732:0:7629:0:(client.c:2716:ptlrpc_set_wait()) set ffff91458665f840 going to sleep for 11 seconds 00000100:00100000:3.0:1790946392.802928:0:7642:0:(client.c:2716:ptlrpc_set_wait()) set ffff914586872cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790946392.803998:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303292032 00000100:00100000:0.0:1790946392.804008:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303292032 00000100:00100000:0.0:1790946392.804116:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790946392.804126:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682ead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7642:x1877943303292032:12345-0@lo:901: 00000100:00080000:1.0:1790946392.804653:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790946392.804901:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682ead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7642:x1877943303292032:12345-0@lo:901: Request processed in 774us (3456us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946392.804910:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1790946392.805047:0:7642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff914682eadc00 x1877943303292032/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1790946408 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946392.805061:0:7642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914682eadc00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7642:1877943303292032:0@lo:901: 00000100:00100000:1.0:1790946392.805275:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303292160 00000100:00100000:1.0:1790946392.805282:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303292160 00000100:00100000:1.0:1790946392.805316:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1790946392.805324:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+14:7629:x1877943303292160:12345-0@lo:253: 20000000:01000000:1.0:1790946392.805349:0:5828:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1790946392.805361:0:5828:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1790946392.833407:0:5828:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1790946392.833429:0:5828:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1790946392.833521:0:5850:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1790946392.833526:0:5850:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1790946392.833549:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff914688aee800/0x16e41aef93271bb7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946392.833569:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9146c20cac00/0x16e41aef93271b08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93271b01 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946392.833578:0:5850:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff914688aee800/0x16e41aef93271bb7 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946392.833619:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9146c20cac00/0x16e41aef93271b08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x16e41aef93271b01 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946392.833634:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9146c20cac00/0x16e41aef93271b08 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x16e41aef93271b01 expref: 14 pid: 5827 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946392.833649:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee38000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5850:1877943303292288:0@lo:104: 00000100:00100000:2.0:1790946392.833716:0:5850:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946392.833766:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146c1c9ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1790946392.833890:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303292288 00000100:00100000:0.0:1790946392.833899:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303292288 00000100:00100000:0.0:1790946392.833956:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790946392.833966:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+3:5850:x1877943303292288:12345-0@lo:104: 00010000:00010000:0.0:1790946392.833980:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff914680030c00/0x16e41aef93271b01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93271b08 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946392.834032:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790946392.834038:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+3:5850:x1877943303292288:12345-0@lo:104: Request processed in 75us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946392.834045:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790946392.834142:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee38000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5850:1877943303292288:0@lo:104: 00010000:00010000:2.0:1790946392.834161:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff914688aee800/0x16e41aef93271bb7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946392.834474:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790946392.834482:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff914680030c00/0x16e41aef93271b01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93271b08 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946392.834490:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914680030c00 already unused, calling callback (ffffffffc1d96c20) 10000000:00010000:3.0:1790946392.834494:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff914680030c00/0x16e41aef93271b01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x16e41aef93271b08 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946392.834513:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff914680030c00/0x16e41aef93271b01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x16e41aef93271b08 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790946392.834530:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff914680030c00/0x16e41aef93271b01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x16e41aef93271b08 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790946392.834536:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1790946392.834571:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff914680030c00/0x16e41aef93271b01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271b08 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946392.834578:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790946392.834607:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff914680030c00/0x16e41aef93271b01 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271b08 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946392.834615:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff914680030c00/0x16e41aef93271b01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271b08 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946392.834633:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946392.834635:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946392.834637:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946392.834645:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790946392.834657:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914682eafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3301:1877943303292416:0@lo:103: 00000100:00100000:3.0:1790946392.834695:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946392.834733:0:5821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303292416 00000100:00100000:3.0:1790946392.834737:0:5821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303292416 00010000:00010000:3.0:1790946392.834759:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9146c20cac00/0x16e41aef93271b08 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef93271b01 expref: 15 pid: 5827 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946392.834781:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790946392.834789:0:5821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914685715050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+15:3301:x1877943303292416:12345-0@lo:103: 00010000:00010000:3.0:1790946392.834799:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790946392.834805:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9146c20cac00/0x16e41aef93271b08 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef93271b01 expref: 15 pid: 5827 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946392.834823:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9146c20cac00/0x16e41aef93271b08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x16e41aef93271b01 expref: 15 pid: 5827 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946392.834836:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9146c20cac00/0x16e41aef93271b08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x16e41aef93271b01 expref: 15 pid: 5827 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946392.834864:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff914688aee800/0x16e41aef93271bb7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946392.834872:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff914688aee800/0x16e41aef93271bb7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790946392.834886:0:5821:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004181117s 00010000:00010000:3.0:1790946392.834890:0:5821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff914688aee800/0x16e41aef93271bb7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946392.834898:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff914688aee800/0x16e41aef93271bb7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946392.834905:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff914688aee800/0x16e41aef93271bb7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946392.834912:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff914688aee800/0x16e41aef93271bb7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946392.834918:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aee800 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:3.0:1790946392.834923:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff914688aee800/0x16e41aef93271bb7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946392.834931:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff914688aee800/0x16e41aef93271bb7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946392.834951:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff914688aee800/0x16e41aef93271bb7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946392.834962:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790946392.834994:0:5821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914685715050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+14:3301:x1877943303292416:12345-0@lo:103: Request processed in 205us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946392.835001:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790946392.835059:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914682eafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3301:1877943303292416:0@lo:103: 00010000:00010000:3.0:1790946392.835075:0:5850:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff914688aee800/0x16e41aef93271bb7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946392.835083:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff914688aee800/0x16e41aef93271bb7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946392.835090:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff914688aee800/0x16e41aef93271bb7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946392.850370:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+13:7629:x1877943303292160:12345-0@lo:253: Request processed in 45037us (48657us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946392.850385:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1790946392.850412:0:7629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee38380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:7629:1877943303292160:0@lo:253: 10000000:01000000:2.0:1790946392.850428:0:7629:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1790946392.850431:0:7629:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790946392.850447:0:7629:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790946392.850449:0:7629:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790946392.850450:0:7629:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790946392.850451:0:7629:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790946392.850452:0:7629:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790946392.850454:0:7629:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790946392.850455:0:7629:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790946392.850457:0:7629:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790946392.850458:0:7629:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790946392.850460:0:7629:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1790946392.850478:0:7629:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1790946392.865687:0:7629:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1790946392.865910:0:7629:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1790946392.866867:0:7629:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1790946392.867099:0:7629:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1790946392.868006:0:7629:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1790946392.868648:0:7629:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1790946392.873971:0:7629:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1790946393.160585:0:7629:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1790946393.160594:0:7629:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1790946393.160629:0:7629:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1790946393.160826:0:7629:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.113@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1790946393.160850:0:7629:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1790946393.160877:0:7629:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1790946393.332387:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946394.352395:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946395.376384:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946396.400759:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946397.425138:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946397.684197:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790946397.684968:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303292544:0@lo:13: 00000100:00100000:1.0:1790946397.685067:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946397.689120:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303292544 00000100:00100000:0.0:1790946397.689143:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303292544 00000100:00100000:0.0:1790946397.689275:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1790946397.689276:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790946397.689292:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b68a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303292544:12345-0@lo:13: 00002000:00000024:0.0:1790946397.689347:0:6678:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790946397.689469:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b68a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303292544:12345-0@lo:13: Request processed in 183us (4402us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946397.689477:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1790946397.690129:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146bee38380 x1877943303292544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790946413 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946397.690156:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303292544:0@lo:13: 00000100:00100000:3.0:1790946398.199655:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914682eac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877943303292800:0@lo:400: 00000100:00100000:3.0:1790946398.199765:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946398.199849:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1790946398.199856:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914682eafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3303:1877943303292672:0@lo:400: 00000100:00100000:3.0:1790946398.199893:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946398.199920:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914682eaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1877943303293184:0@lo:400: 00000100:00100000:3.0:1790946398.199954:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946398.199982:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914682ead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303293056:0@lo:400: 00000100:00100000:3.0:1790946398.200010:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946398.200027:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790946398.200033:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914682eace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1877943303292928:0@lo:400: 00000100:00100000:3.0:1790946398.200056:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946398.200116:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303292672 00000100:00100000:3.0:1790946398.200126:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303292672 00000100:00100000:3.0:1790946398.200179:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1790946398.200190:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+13:3303:x1877943303292672:12345-0@lo:400: 00000100:00100000:3.0:1790946398.200280:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+13:3303:x1877943303292672:12345-0@lo:400: Request processed in 91us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946398.200289:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1790946398.200339:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914682eafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3303:1877943303292672:0@lo:400: 00000100:00100000:0.0:1790946398.200451:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303292800 00000100:00100000:0.0:1790946398.200456:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303292800 00000100:00100000:0.0:1790946398.200489:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303293184 00000100:00100000:0.0:1790946398.200492:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303293184 00000100:00100000:0.0:1790946398.200515:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303292928 00000100:00100000:0.0:1790946398.200518:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303292928 00000100:00100000:0.0:1790946398.200533:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790946398.200540:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682eae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877943303292800:12345-0@lo:400: 00000100:00100000:0.0:1790946398.200585:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682eae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877943303292800:12345-0@lo:400: Request processed in 45us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946398.200591:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790946398.200605:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790946398.200611:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682eaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877943303293184:12345-0@lo:400: 00000100:00100000:0.0:1790946398.200640:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682eaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877943303293184:12345-0@lo:400: Request processed in 29us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946398.200646:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790946398.200658:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790946398.200673:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682eac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1877943303292928:12345-0@lo:400: 00000100:00100000:0.0:1790946398.200710:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682eac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1877943303292928:12345-0@lo:400: Request processed in 38us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946398.200716:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1790946398.200735:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1790946398.200762:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff914682eaed80 x1877943303293184/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946398.200774:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914682eaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1877943303293184:0@lo:400: 00010000:00080000:0.0:1790946398.200786:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff914682eac380 x1877943303292800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946398.200793:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914682eac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877943303292800:0@lo:400: 00010000:00080000:0.0:1790946398.200829:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff914682eace00 x1877943303292928/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946398.200837:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914682eace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1877943303292928:0@lo:400: 00000100:00100000:1.0:1790946398.202251:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303293056 00000100:00100000:1.0:1790946398.202265:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303293056 00000100:00100000:1.0:1790946398.202320:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790946398.202330:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682eadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1877943303293056:12345-0@lo:400: 00000100:00100000:1.0:1790946398.202417:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682eadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1877943303293056:12345-0@lo:400: Request processed in 89us (2405us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946398.202424:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1790946398.202480:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff914682ead180 x1877943303293056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790946414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946398.202494:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914682ead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303293056:0@lo:400: 00010000:00010000:2.0:1790946398.448486:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946399.472603:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1790946400.241286:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1790946400.241298:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9146be38b800 from 30 10000000:01000000:2.0:1790946400.241306:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790946400.241369:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff914688aee800/0x16e41aef93271bbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946400.241384:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff914688aee800/0x16e41aef93271bbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946400.241398:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff914688aee800/0x16e41aef93271bbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946400.241432:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee38000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303293312:0@lo:101: 00000100:00100000:2.0:1790946400.241559:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946400.241632:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146a0aa4000 going to sleep for 11 seconds 00000100:00100000:1.0:1790946400.241681:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303293312 00000100:00100000:1.0:1790946400.241692:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303293312 00000100:00100000:1.0:1790946400.241761:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1790946400.241771:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+13:5831:x1877943303293312:12345-0@lo:101: 00010000:00010000:1.0:1790946400.241796:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946400.241811:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9146b180fc00/0x16e41aef93271bc5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x16e41aef93271bbe expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946400.241840:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9146b180fc00/0x16e41aef93271bc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x16e41aef93271bbe expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946400.241865:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9146b180fc00/0x16e41aef93271bc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93271bbe expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946400.241877:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b180fc00, rc 0) 00000100:00100000:1.0:1790946400.241937:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+14:5831:x1877943303293312:12345-0@lo:101: Request processed in 167us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946400.241945:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1790946400.241971:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee38000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303293312:0@lo:101: 00010000:00010000:2.0:1790946400.241990:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff914688aee800/0x16e41aef93271bbe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271bc5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946400.242000:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff914688aee800/0x16e41aef93271bbe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93271bc5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946400.242063:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee38000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303293440:0@lo:501: 00000100:00100000:2.0:1790946400.242092:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946400.242112:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146a0aa4000 going to sleep for 11 seconds 00000100:00100000:2.0:1790946400.242127:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303293440 00000100:00100000:2.0:1790946400.242131:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303293440 00000100:00100000:2.0:1790946400.242156:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1790946400.242162:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+14:5831:x1877943303293440:12345-0@lo:501: 00000100:00100000:2.0:1790946400.243940:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+14:5831:x1877943303293440:12345-0@lo:501: Request processed in 1766us (1834us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946400.243957:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1790946400.244589:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee38000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303293440:0@lo:501: 00000100:00100000:2.0:1790946400.244665:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee38000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303293568:0@lo:503: 00000100:00100000:2.0:1790946400.244729:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946400.244772:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146a0aa4000 going to sleep for 11 seconds 00000100:00100000:1.0:1790946400.245126:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303293568 00000100:00100000:1.0:1790946400.245137:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303293568 00000100:00100000:1.0:1790946400.246398:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1790946400.246423:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+14:5831:x1877943303293568:12345-0@lo:503: 00000100:00100000:1.0:1790946400.247078:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+14:5831:x1877943303293568:12345-0@lo:503: Request processed in 664us (2347us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946400.247090:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1790946400.247231:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee38000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303293568:0@lo:503: 00000100:00100000:3.0:1790946400.251112:0:7981:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914682eafb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:7981:1877943303293696:0@lo:502: 00000100:00100000:3.0:1790946400.251388:0:7981:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946400.251450:0:7981:0:(client.c:2716:ptlrpc_set_wait()) set ffff914584b3c180 going to sleep for 11 seconds 00000100:00100000:2.0:1790946400.253479:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303293696 00000100:00100000:2.0:1790946400.253500:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303293696 00000100:00100000:2.0:1790946400.253586:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1790946400.253596:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+14:7981:x1877943303293696:12345-0@lo:502: 00000100:00100000:2.0:1790946400.254417:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+14:7981:x1877943303293696:12345-0@lo:502: Request processed in 818us (3027us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946400.254456:0:7981:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914682eafb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:7981:1877943303293696:0@lo:502: 00000100:00100000:3.0:1790946400.254556:0:7981:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914682eafb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:7981:1877943303293824:0@lo:502: 00000100:00100000:3.0:1790946400.254617:0:7981:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946400.254666:0:7981:0:(client.c:2716:ptlrpc_set_wait()) set ffff914684eb89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790946400.256695:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1790946400.256699:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303293824 00000100:00100000:1.0:1790946400.257016:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303293824 00000100:00100000:1.0:1790946400.257154:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1790946400.257165:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+14:7981:x1877943303293824:12345-0@lo:502: 00000100:00100000:1.0:1790946400.257686:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+14:7981:x1877943303293824:12345-0@lo:502: Request processed in 521us (3069us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946400.257695:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1790946400.257732:0:7981:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914682eafb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:7981:1877943303293824:0@lo:502: 00000040:00080000:3.0:1790946400.257807:0:7981:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1790946400.259429:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1790946400.259473:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790946400.259488:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff914688aee800/0x16e41aef93271bbe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271bc5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946400.259503:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff914688aee800/0x16e41aef93271bbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271bc5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790946400.259527:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1790946400.259532:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1790946400.259535:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1790946400.259593:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146b180fa00/0x16e41aef93271bcc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946400.259606:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9146b180fa00/0x16e41aef93271bcc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946400.259620:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9146b180fa00/0x16e41aef93271bcc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946400.259656:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b68a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303293952:0@lo:101: 00000100:00100000:1.0:1790946400.259765:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946400.259849:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff914682ecf900 going to sleep for 11 seconds 00000100:00100000:2.0:1790946400.260178:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303293952 00000100:00100000:2.0:1790946400.260190:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303293952 00000100:00100000:2.0:1790946400.260276:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1790946400.260289:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+14:5831:x1877943303293952:12345-0@lo:101: 00010000:00010000:2.0:1790946400.260316:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946400.260333:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff914688aee000/0x16e41aef93271bd3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x16e41aef93271bcc expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946400.260363:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff914688aee000/0x16e41aef93271bd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x16e41aef93271bcc expref: 15 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946400.260376:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff914688aee000/0x16e41aef93271bd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93271bcc expref: 15 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946400.260386:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914688aee000, rc 0) 00000100:00100000:2.0:1790946400.260577:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+15:5831:x1877943303293952:12345-0@lo:101: Request processed in 289us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946400.260585:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1790946400.262279:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b68a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303293952:0@lo:101: 00010000:00010000:1.0:1790946400.262326:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9146b180fa00/0x16e41aef93271bcc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271bd3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946400.262343:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9146b180fa00/0x16e41aef93271bcc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93271bd3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946400.262453:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b68a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303294080:0@lo:501: 00000100:00100000:1.0:1790946400.262545:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946400.262604:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff914682ecf900 going to sleep for 11 seconds 00000100:00100000:1.0:1790946400.262637:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303294080 00000100:00100000:1.0:1790946400.262647:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303294080 00000100:00100000:1.0:1790946400.262709:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1790946400.262739:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+15:5831:x1877943303294080:12345-0@lo:501: 00000100:00100000:1.0:1790946400.265026:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+15:5831:x1877943303294080:12345-0@lo:501: Request processed in 2277us (2466us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946400.265046:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1790946400.265367:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b68a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303294080:0@lo:501: 00000100:00100000:0.0:1790946400.265447:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bdcc9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303294208:0@lo:503: 00000100:00100000:0.0:1790946400.265504:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946400.265542:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146a0379a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790946400.265881:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303294208 00000100:00100000:1.0:1790946400.265891:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303294208 00000100:00100000:1.0:1790946400.265952:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1790946400.265963:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+15:5831:x1877943303294208:12345-0@lo:503: 00000100:00100000:1.0:1790946400.266641:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+15:5831:x1877943303294208:12345-0@lo:503: Request processed in 674us (1131us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946400.266657:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1790946400.267245:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bdcc9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303294208:0@lo:503: 00000100:00100000:2.0:1790946400.270622:0:7986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee38000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:7986:1877943303294336:0@lo:502: 00000100:00100000:2.0:1790946400.270745:0:7986:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946400.270813:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303294336 00000100:00100000:2.0:1790946400.270820:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303294336 00000100:00100000:2.0:1790946400.271930:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1790946400.271948:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+15:7986:x1877943303294336:12345-0@lo:502: 00000100:00100000:2.0:1790946400.272769:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+15:7986:x1877943303294336:12345-0@lo:502: Request processed in 820us (2018us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946400.272780:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1790946400.273284:0:7986:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146a0aa4c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790946400.273322:0:7986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee38000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:7986:1877943303294336:0@lo:502: 00000020:01000000:2.0:1790946400.273368:0:7986:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790946400.273381:0:7986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946400.273385:0:7986:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790946400.273394:0:7986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790946400.273396:0:7986:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1790946400.273917:0:7986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee38000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:7986:1877943303294464:0@lo:502: 00000100:00100000:2.0:1790946400.274064:0:7986:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946400.274107:0:7986:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146a0aa4c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790946400.274129:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303294464 00000100:00100000:0.0:1790946400.274138:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303294464 00000100:00100000:0.0:1790946400.274196:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1790946400.274226:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+15:7986:x1877943303294464:12345-0@lo:502: 00000100:00100000:0.0:1790946400.274497:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+15:7986:x1877943303294464:12345-0@lo:502: Request processed in 274us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946400.274513:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1790946400.274568:0:7986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee38000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:7986:1877943303294464:0@lo:502: 00000020:01000000:2.0:1790946400.274598:0:7986:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790946400.274607:0:7986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946400.274609:0:7986:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1790946400.274615:0:7986:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1790946400.275461:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1790946400.275501:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1790946400.275515:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146b180fa00/0x16e41aef93271bcc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271bd3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946400.275529:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9146b180fa00/0x16e41aef93271bcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271bd3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790946400.275541:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1790946400.275544:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9146aa748800 from 30 10000000:01000000:0.0:1790946400.275547:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790946400.275588:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff914680030c00/0x16e41aef93271bda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946400.275598:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff914680030c00/0x16e41aef93271bda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946400.275610:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff914680030c00/0x16e41aef93271bda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946400.275631:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bdcc9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303294592:0@lo:101: 00000100:00100000:0.0:1790946400.275705:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946400.275751:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146a0379b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790946400.277077:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303294592 00000100:00100000:2.0:1790946400.277095:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303294592 00000100:00100000:2.0:1790946400.277170:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1790946400.277182:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+15:5831:x1877943303294592:12345-0@lo:101: 00010000:00010000:2.0:1790946400.277221:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946400.277253:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff914688aee200/0x16e41aef93271be1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x16e41aef93271bda expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946400.277289:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff914688aee200/0x16e41aef93271be1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x16e41aef93271bda expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946400.277324:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff914688aee200/0x16e41aef93271be1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93271bda expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946400.277335:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914688aee200, rc 0) 00000100:00100000:2.0:1790946400.277431:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+16:5831:x1877943303294592:12345-0@lo:101: Request processed in 250us (1724us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946400.277440:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1790946400.277471:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bdcc9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303294592:0@lo:101: 00010000:00010000:0.0:1790946400.277495:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff914680030c00/0x16e41aef93271bda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271be1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946400.277506:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff914680030c00/0x16e41aef93271bda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93271be1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946400.277592:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bdcc9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303294720:0@lo:501: 00000100:00100000:0.0:1790946400.277631:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946400.277670:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303294720 00000100:00100000:0.0:1790946400.277674:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146a0379b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790946400.277676:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303294720 00000100:00100000:2.0:1790946400.277702:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1790946400.277721:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+16:5831:x1877943303294720:12345-0@lo:501: 00000100:00100000:2.0:1790946400.278431:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+16:5831:x1877943303294720:12345-0@lo:501: Request processed in 717us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946400.278442:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1790946400.279470:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bdcc9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303294720:0@lo:501: 00000100:00100000:0.0:1790946400.279536:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bdcc9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303294848:0@lo:503: 00000100:00100000:0.0:1790946400.279616:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946400.279670:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303294848 00000100:00100000:0.0:1790946400.279673:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146a0379b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790946400.279679:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303294848 00000100:00100000:2.0:1790946400.279866:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1790946400.279880:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+16:5831:x1877943303294848:12345-0@lo:503: 00000100:00100000:2.0:1790946400.280298:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+16:5831:x1877943303294848:12345-0@lo:503: Request processed in 420us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946400.280308:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1790946400.280427:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bdcc9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303294848:0@lo:503: 00000100:00100000:0.0:1790946400.281108:0:7987:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bdcc9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:7987:1877943303294976:0@lo:502: 00000100:00100000:0.0:1790946400.281168:0:7987:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946400.281244:0:7987:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146a0379480 going to sleep for 11 seconds 00000100:00100000:2.0:1790946400.281417:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303294976 00000100:00100000:2.0:1790946400.281425:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303294976 00000100:00100000:2.0:1790946400.281472:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1790946400.281481:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+16:7987:x1877943303294976:12345-0@lo:502: 00000100:00100000:2.0:1790946400.281735:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+16:7987:x1877943303294976:12345-0@lo:502: Request processed in 255us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946400.281749:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1790946400.281812:0:7987:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bdcc9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:7987:1877943303294976:0@lo:502: 00000100:00100000:2.0:1790946400.281884:0:7987:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee38000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:7987:1877943303295104:0@lo:502: 00000100:00100000:2.0:1790946400.281922:0:7987:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946400.281945:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303295104 00000100:00100000:2.0:1790946400.281955:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303295104 00000100:00100000:2.0:1790946400.281976:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1790946400.281982:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+16:7987:x1877943303295104:12345-0@lo:502: 00000100:00100000:2.0:1790946400.284508:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+16:7987:x1877943303295104:12345-0@lo:502: Request processed in 2513us (2573us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946400.284526:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1790946400.284618:0:7987:0:(client.c:2716:ptlrpc_set_wait()) set ffff91468758c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790946400.284650:0:7987:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee38000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:7987:1877943303295104:0@lo:502: 00000040:00080000:2.0:1790946400.284687:0:7987:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1790946400.288517:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1790946400.288568:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790946400.288584:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff914680030c00/0x16e41aef93271bda lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271be1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946400.288600:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff914680030c00/0x16e41aef93271bda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271be1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790946400.288613:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790946400.288616:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9146aa748800 from 5 10000000:01000000:0.0:1790946400.288620:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790946400.288683:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff914680030600/0x16e41aef93271be8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946400.288693:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff914680030600/0x16e41aef93271be8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946400.288725:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff914680030600/0x16e41aef93271be8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946400.288757:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bdccaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303295232:0@lo:101: 00000100:00100000:0.0:1790946400.288925:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946400.288993:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146a0379d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790946400.290641:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303295232 00000100:00100000:2.0:1790946400.290660:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303295232 00000100:00100000:2.0:1790946400.290735:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1790946400.290747:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+16:5831:x1877943303295232:12345-0@lo:101: 00010000:00010000:2.0:1790946400.290773:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946400.290809:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff914688aefe00/0x16e41aef93271bef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x16e41aef93271be8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946400.290843:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff914688aefe00/0x16e41aef93271bef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x16e41aef93271be8 expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946400.290857:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff914688aefe00/0x16e41aef93271bef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93271be8 expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946400.290888:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914688aefe00, rc 0) 00000100:00100000:2.0:1790946400.290992:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+17:5831:x1877943303295232:12345-0@lo:101: Request processed in 248us (2068us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946400.290999:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1790946400.291084:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bdccaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303295232:0@lo:101: 00010000:00010000:2.0:1790946400.291105:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff914680030600/0x16e41aef93271be8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271bef expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946400.291116:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff914680030600/0x16e41aef93271be8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93271bef expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946400.291190:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee38000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303295360:0@lo:256: 00000100:00100000:2.0:1790946400.291252:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946400.291280:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303295360 00000100:00100000:2.0:1790946400.291284:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303295360 00000100:00100000:2.0:1790946400.291307:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1790946400.291326:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+17:5831:x1877943303295360:12345-0@lo:256: 20000000:01000000:2.0:1790946400.291343:0:5829:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790946400.291363:0:5829:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790946400.291366:0:5829:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1790946400.291440:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+17:5831:x1877943303295360:12345-0@lo:256: Request processed in 125us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946400.291447:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1790946400.291481:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff91468758cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1790946400.291492:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee38000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303295360:0@lo:256: 10000000:01000000:2.0:1790946400.291535:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790946400.291546:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff914680030600/0x16e41aef93271be8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271bef expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946400.291554:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff914680030600/0x16e41aef93271be8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271bef expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790946400.291563:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1790946400.291566:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1790946400.291569:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1790946400.291589:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff914688aefc00/0x16e41aef93271bf6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946400.291598:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff914688aefc00/0x16e41aef93271bf6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946400.291607:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff914688aefc00/0x16e41aef93271bf6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946400.291618:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee38000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303295488:0@lo:101: 00000100:00100000:2.0:1790946400.291649:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946400.291663:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff91468758cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1790946400.291675:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303295488 00000100:00100000:2.0:1790946400.291678:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303295488 00000100:00100000:2.0:1790946400.291698:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1790946400.291704:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+17:5831:x1877943303295488:12345-0@lo:101: 00010000:00010000:2.0:1790946400.291711:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946400.291721:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff914688aee400/0x16e41aef93271bfd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x16e41aef93271bf6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946400.291735:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff914688aee400/0x16e41aef93271bfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x16e41aef93271bf6 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946400.291750:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff914688aee400/0x16e41aef93271bfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93271bf6 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946400.291756:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914688aee400, rc 0) 00000100:00100000:2.0:1790946400.291781:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+18:5831:x1877943303295488:12345-0@lo:101: Request processed in 77us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946400.291799:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1790946400.291843:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee38000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303295488:0@lo:101: 00010000:00010000:2.0:1790946400.291855:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff914688aefc00/0x16e41aef93271bf6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271bfd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946400.291862:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff914688aefc00/0x16e41aef93271bf6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93271bfd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946400.291915:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee38000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303295616:0@lo:501: 00000100:00100000:2.0:1790946400.291941:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946400.291958:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303295616 00000100:00100000:2.0:1790946400.291961:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303295616 00000100:00100000:2.0:1790946400.291982:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1790946400.291988:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+18:5831:x1877943303295616:12345-0@lo:501: 00000100:00100000:2.0:1790946400.292313:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+18:5831:x1877943303295616:12345-0@lo:501: Request processed in 325us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946400.292320:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1790946400.292344:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9145879aa6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790946400.292356:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee38000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303295616:0@lo:501: 00000100:00100000:2.0:1790946400.292383:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee38000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303295744:0@lo:503: 00000100:00100000:2.0:1790946400.292424:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946400.292445:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303295744 00000100:00100000:2.0:1790946400.292449:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303295744 00000100:00100000:2.0:1790946400.292471:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1790946400.292478:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+18:5831:x1877943303295744:12345-0@lo:503: 00000100:00100000:2.0:1790946400.292778:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+18:5831:x1877943303295744:12345-0@lo:503: Request processed in 299us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946400.292800:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1790946400.292832:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9145879aa6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790946400.292844:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee38000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303295744:0@lo:503: 00000100:00100000:2.0:1790946400.293058:0:7988:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee38000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:7988:1877943303295872:0@lo:502: 00000100:00100000:2.0:1790946400.293092:0:7988:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946400.293112:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303295872 00000100:00100000:2.0:1790946400.293117:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303295872 00000100:00100000:2.0:1790946400.293142:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1790946400.293150:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+18:7988:x1877943303295872:12345-0@lo:502: 00000100:00100000:2.0:1790946400.293400:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+18:7988:x1877943303295872:12345-0@lo:502: Request processed in 250us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946400.293407:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1790946400.293438:0:7988:0:(client.c:2716:ptlrpc_set_wait()) set ffff9145879aa540 going to sleep for 11 seconds 00000100:00100000:2.0:1790946400.293452:0:7988:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee38000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:7988:1877943303295872:0@lo:502: 00000020:01000000:2.0:1790946400.293476:0:7988:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790946400.293484:0:7988:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1790946400.293493:0:7988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946400.293495:0:7988:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1790946400.293502:0:7988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1790946400.293514:0:7988:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.113@tcp to nid 0x20000c0a8cb71 (192.168.203.113@tcp) 00000020:01000000:2.0:1790946400.293540:0:7988:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1790946400.293544:0:7988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790946400.293563:0:7988:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff914684fb19c0) 00000020:00000080:2.0:1790946400.293587:0:7988:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1790946400.293593:0:7988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1790946400.293686:0:7988:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1790946400.293693:0:7988:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:2.0:1790946400.293705:0:7988:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x16e41aef93271c0b 00010000:00080000:2.0:1790946400.293742:0:7988:0:(ldlm_lib.c:102:import_set_conn()) imp ffff914587bb8000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.113@tcp at head 00010000:00010000:2.0:1790946400.296699:0:7988:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:2.0:1790946400.298505:0:7988:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1790946400.298527:0:7988:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1790946400.300759:0:7988:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790946400.302484:0:7988:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790946400.302564:0:7988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1790946400.302634:0:7988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1790946400.306450:0:7989:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790946400.306462:0:7989:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1790946400.307533:0:7988:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790946400.307550:0:7988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1790946400.307596:0:7988:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1790946400.307635:0:7988:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x16e41aef93271c12 00000100:00080000:2.0:1790946400.307648:0:7988:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790946400.307662:0:7988:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff914587bb8000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:2.0:1790946400.307708:0:7988:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9146bee38000 x1877943303296000/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790946400.307745:0:7988:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1790946400.307821:0:7988:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790946400.307826:0:7988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946400.307836:0:7988:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1790946400.307840:0:7988:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790946400.307845:0:7988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946400.307847:0:7988:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790946400.307850:0:7988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790946400.307852:0:7988:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1790946400.307901:0:7988:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee39500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:7988:1877943303296128:0@lo:502: 00000100:00100000:0.0:1790946400.307965:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bdcc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877943303296256:0@lo:400: 00000100:00100000:1.0:1790946400.308065:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bdccb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1877943303296640:0@lo:400: 00000100:00100000:3.0:1790946400.308116:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1877943303296000:0@lo:8: 00000100:00100000:0.0:1790946400.309136:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946400.309217:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303296256 00000100:00100000:0.0:1790946400.309227:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303296256 00000100:00100000:0.0:1790946400.309279:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790946400.309289:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bdcc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877943303296256:12345-0@lo:400: 00000100:00100000:0.0:1790946400.309369:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bdcc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877943303296256:12345-0@lo:400: Request processed in 78us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946400.309379:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1790946400.309439:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146bdcc9180 x1877943303296256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946400.309455:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bdcc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877943303296256:0@lo:400: 00000100:00100000:0.0:1790946400.309675:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bdccad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303296512:0@lo:400: 00000100:00100000:0.0:1790946400.309728:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946400.309754:0:7988:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946400.309774:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790946400.309798:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bdcca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1877943303296384:0@lo:400: 00000100:00100000:2.0:1790946400.309805:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303296128 00000100:00100000:2.0:1790946400.309812:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303296128 00000100:00100000:0.0:1790946400.309839:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946400.309852:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1790946400.309862:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+18:7988:x1877943303296128:12345-0@lo:502: 00000100:00100000:0.0:1790946400.309889:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303296512 00000100:00100000:0.0:1790946400.309894:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303296512 00000100:00100000:0.0:1790946400.309960:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790946400.309967:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bdcc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1877943303296512:12345-0@lo:400: 00000100:00100000:0.0:1790946400.310010:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bdcc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1877943303296512:12345-0@lo:400: Request processed in 44us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946400.310016:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1790946400.310035:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790946400.310073:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146bdccad80 x1877943303296512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790946416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946400.310086:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bdccad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303296512:0@lo:400: 00000100:00100000:2.0:1790946400.310801:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+18:7988:x1877943303296128:12345-0@lo:502: Request processed in 926us (1033us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946400.310812:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1790946400.310982:0:7988:0:(client.c:2716:ptlrpc_set_wait()) set ffff9145879aaa80 going to sleep for 11 seconds 00000100:00100000:2.0:1790946400.311005:0:7988:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee39500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:7988:1877943303296128:0@lo:502: 00000020:01000000:2.0:1790946400.311108:0:7988:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790946400.311118:0:7988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946400.311121:0:7988:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:2.0:1790946400.311127:0:7988:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1790946400.311234:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1790946400.311264:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1790946400.311276:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff914688aefc00/0x16e41aef93271bf6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271bfd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946400.311288:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff914688aefc00/0x16e41aef93271bf6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271bfd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790946400.311300:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1790946400.311311:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff914682e5b380 from 1 10000000:01000000:2.0:1790946400.311944:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1790946400.311996:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff914688aef400/0x16e41aef93271c19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946400.312007:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff914688aef400/0x16e41aef93271c19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946400.312018:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff914688aef400/0x16e41aef93271c19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946400.312157:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee39500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303296768:0@lo:101: 00000100:00100000:2.0:1790946400.312262:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946400.312297:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9145879aaa80 going to sleep for 11 seconds 00000100:00100000:2.0:1790946400.312394:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303296768 00000100:00100000:2.0:1790946400.312403:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303296768 00000100:00100000:2.0:1790946400.312455:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1790946400.312477:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+18:5831:x1877943303296768:12345-0@lo:101: 00010000:00010000:2.0:1790946400.312493:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946400.312510:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff914688aef800/0x16e41aef93271c20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x16e41aef93271c19 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946400.312540:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff914688aef800/0x16e41aef93271c20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x16e41aef93271c19 expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946400.312552:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff914688aef800/0x16e41aef93271c20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93271c19 expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946400.312562:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914688aef800, rc 0) 00000100:00100000:2.0:1790946400.312605:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:5831:x1877943303296768:12345-0@lo:101: Request processed in 142us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946400.312624:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1790946400.312679:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee39500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303296768:0@lo:101: 00010000:00010000:2.0:1790946400.312698:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff914688aef400/0x16e41aef93271c19 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271c20 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946400.312708:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff914688aef400/0x16e41aef93271c19 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93271c20 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946400.312768:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee39500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303296896:0@lo:501: 00000100:00100000:2.0:1790946400.312808:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946400.312823:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9145879aaa80 going to sleep for 11 seconds 00000100:00100000:2.0:1790946400.312837:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303296896 00000100:00100000:2.0:1790946400.312840:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303296896 00000100:00100000:2.0:1790946400.312861:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1790946400.312868:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:5831:x1877943303296896:12345-0@lo:501: 00000001:02000400:0.0:1790946400.313352:0:7985:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1790946400.314662:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946400.314726:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:5831:x1877943303296896:12345-0@lo:501: Request processed in 1855us (1914us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790946400.314740:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1790946400.314811:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303296384 00000100:00100000:1.0:1790946400.314825:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303296384 00000100:00100000:2.0:1790946400.314838:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee39500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303296896:0@lo:501: 00000100:00100000:1.0:1790946400.314898:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303296640 00000100:00100000:1.0:1790946400.314902:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303296640 00000100:00100000:1.0:1790946400.314921:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790946400.314930:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bdccb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1877943303296384:12345-0@lo:400: 00000100:00100000:1.0:1790946400.315013:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bdccb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1877943303296384:12345-0@lo:400: Request processed in 82us (5175us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946400.315024:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790946400.315053:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790946400.315066:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b68aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877943303296640:12345-0@lo:400: 00000100:00100000:1.0:1790946400.315120:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b68aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877943303296640:12345-0@lo:400: Request processed in 57us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946400.315127:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1790946400.315195:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1790946400.315285:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146bdcca680 x1877943303296384/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946400.315302:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bdcca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1877943303296384:0@lo:400: 00010000:00080000:1.0:1790946400.315349:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146bdccb800 x1877943303296640/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946400.315361:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bdccb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1877943303296640:0@lo:400: 10000000:01000000:2.0:1790946400.316172:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1790946400.316187:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff914688aef400/0x16e41aef93271c19 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271c20 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946400.316215:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff914688aef400/0x16e41aef93271c19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271c20 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946400.317593:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946400.317810:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303296000 00000100:00100000:1.0:1790946400.317824:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303296000 00000100:00100000:1.0:1790946400.317881:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790946400.317889:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682eafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3299:x1877943303296000:12345-0@lo:8: 00010000:00080000:1.0:1790946400.317929:0:6673:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 185 last 0 00000020:00000080:1.0:1790946400.318015:0:6673:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x16e41aef93271c27 00002000:00100000:1.0:1790946400.318034:0:6673:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9146bed8a800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b03 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1790946400.318040:0:6673:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1790946400.318044:0:6673:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1790946400.318267:0:6673:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1790946400.318543:0:6673:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1790946400.318589:0:6673:0:(import.c:65:import_set_state_nolock()) ffff9146bed8f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790946400.318693:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682eafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3299:x1877943303296000:12345-0@lo:8: Request processed in 802us (1109us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946400.318704:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1790946400.319578:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146bee38000 x1877943303296000/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790946410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946400.319595:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790946400.319609:0:3299:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1790946400.319623:0:3299:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1790946400.319631:0:3299:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1790946400.319636:0:3299:0:(import.c:65:import_set_state_nolock()) ffff914587bb8000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1790946400.319669:0:3299:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1790946400.319678:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1877943303296000:0@lo:8: 00000004:00080000:2.0:1790946400.319984:0:7989:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1790946400.320191:0:7989:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 185391989168ns, next at 0ns, rc = 0 00000004:00080000:1.0:1790946400.391290:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:2.0:1790946400.410798:0:7990:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1790946400.410843:0:7990:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee39f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7990:1877943303297152:0@lo:7: 00000100:00100000:2.0:1790946400.410941:0:7990:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946400.411011:0:7990:0:(client.c:2716:ptlrpc_set_wait()) set ffff9145879aaa80 going to sleep for 11 seconds 00000100:00100000:3.0:1790946400.411071:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303297024:0@lo:13: 00000100:00100000:3.0:1790946400.411105:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946400.411167:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303297152 00000100:00100000:0.0:1790946400.411179:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303297152 00000100:00100000:2.0:1790946400.411190:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303297024 00000100:00100000:2.0:1790946400.411197:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303297024 00000100:00100000:2.0:1790946400.411264:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790946400.411275:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682eae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1877943303297024:12345-0@lo:13: 00000100:00100000:0.0:1790946400.411303:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790946400.411313:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7990:x1877943303297152:12345-0@lo:7: 00002000:00000024:2.0:1790946400.411321:0:6678:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1790946400.411381:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682eae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1877943303297024:12345-0@lo:13: Request processed in 107us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946400.411390:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1790946400.411443:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146bee39500 x1877943303297024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790946416 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946400.411480:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303297024:0@lo:13: 00000100:00080000:3.0:1790946400.411606:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:3.0:1790946400.434068:0:6675:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1790946400.434090:0:6675:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1790946400.434312:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7990:x1877943303297152:12345-0@lo:7: Request processed in 22993us (23363us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946400.434328:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1790946400.434993:0:7990:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146bee39f80 x1877943303297152/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790946416 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946400.435024:0:7990:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee39f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7990:1877943303297152:0@lo:7: 00000004:00080000:0.0:1790946400.435044:0:7990:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1790946400.435112:0:7990:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bdccad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7990:1877943303297280:0@lo:5: 00000100:00100000:0.0:1790946400.435166:0:7990:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946400.435247:0:7990:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146a0379d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790946400.437425:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303297280 00000100:00100000:2.0:1790946400.437445:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303297280 00000100:00100000:2.0:1790946400.437573:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790946400.437587:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bdcc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7990:x1877943303297280:12345-0@lo:5: 00002000:00080000:2.0:1790946400.437631:0:6673:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1790946400.437637:0:6673:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1790946400.438194:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bdcc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7990:x1877943303297280:12345-0@lo:5: Request processed in 608us (3026us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1790946400.438244:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1790946400.438483:0:7990:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146bdccad80 x1877943303297280/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790946416 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946400.438500:0:7990:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bdccad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7990:1877943303297280:0@lo:5: 00000004:00080000:1.0:1790946400.438522:0:7990:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1790946400.438565:0:7990:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b68aa300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7990:1877943303297408:0@lo:700: 00000100:00100000:1.0:1790946400.438602:0:7990:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946400.438623:0:7990:0:(client.c:2716:ptlrpc_set_wait()) set ffff914684afd240 going to sleep for 11 seconds 00000100:00100000:0.0:1790946400.438855:0:6682:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303297408 00000100:00100000:0.0:1790946400.438864:0:6682:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303297408 00000100:00100000:0.0:1790946400.438916:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790946400.438925:0:6682:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b68a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7990:x1877943303297408:12345-0@lo:700: 00000100:00100000:0.0:1790946400.438983:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bdcc8380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6682:1877943303297536:0@lo:700: 00000100:00100000:0.0:1790946400.439026:0:6682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946400.439046:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146a0379480 going to sleep for 11 seconds 00000100:00100000:0.0:1790946400.439065:0:5841:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303297536 00000100:00100000:0.0:1790946400.439069:0:5841:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303297536 00000100:00100000:0.0:1790946400.439098:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790946400.439106:0:5841:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bdccb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6682:x1877943303297536:12345-0@lo:700: 00010000:00010000:3.0:1790946400.496545:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 40000000:02000000:1.0:1790946400.500409:0:5841:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1790946400.510091:0:5841:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bdccb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6682:x1877943303297536:12345-0@lo:700: Request processed in 70970us (71049us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946400.510120:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1790946400.510351:0:6682:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146bdcc8380 x1877943303297536/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1790946416 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946400.510371:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bdcc8380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6682:1877943303297536:0@lo:700: 40000000:02000000:3.0:1790946400.510390:0:6682:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00100000:0.0:1790946400.603377:0:7645:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1790946400.603404:0:7645:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:3.0:1790946400.603732:0:6682:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b68a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7990:x1877943303297408:12345-0@lo:700: Request processed in 164801us (165121us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946400.603747:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1790946400.604735:0:7990:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146b68aa300 x1877943303297408/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1790946416 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946400.604751:0:7990:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1790946400.604776:0:7990:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b68aa300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7990:1877943303297408:0@lo:700: 00000004:02000040:1.0:1790946400.650687:0:7990:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:1.0:1790946400.656597:0:7990:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b68aa300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7990:1877943303297664:0@lo:5: 00000100:00100000:1.0:1790946400.656703:0:7990:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946400.656857:0:7990:0:(client.c:2716:ptlrpc_set_wait()) set ffff91468574fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790946400.656955:0:6808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303297664 00000100:00100000:2.0:1790946400.656966:0:6808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303297664 00000100:00100000:2.0:1790946400.657039:0:6808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790946400.657051:0:6808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b68aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:7990:x1877943303297664:12345-0@lo:5: 00002000:00080000:0.0:1790946400.688703:0:6808:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1790946400.688732:0:6808:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1790946400.702740:0:6808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b68aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:7990:x1877943303297664:12345-0@lo:5: Request processed in 45681us (46026us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1790946400.702758:0:6808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1790946400.704412:0:7990:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146b68aa300 x1877943303297664/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790946416 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946400.704437:0:7990:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b68aa300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7990:1877943303297664:0@lo:5: 00000004:00080000:0.0:1790946400.704461:0:7990:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:0.0:1790946401.520464:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946402.544408:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946402.804271:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303297792:0@lo:13: 00000100:00100000:0.0:1790946402.804382:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946402.806440:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303297792 00000100:00100000:2.0:1790946402.806461:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303297792 00000100:00100000:2.0:1790946402.806562:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790946402.806576:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bdccad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303297792:12345-0@lo:13: 00002000:00000024:2.0:1790946402.806632:0:6678:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790946402.806750:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bdccad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303297792:12345-0@lo:13: Request processed in 178us (2368us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946402.806759:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1790946402.806945:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790946402.807908:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146bee39500 x1877943303297792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790946418 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946402.807942:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303297792:0@lo:13: 00010000:00010000:0.0:1790946403.571710:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946404.592448:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946405.361843:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3301:1877943303297920:0@lo:400: 00000100:00100000:3.0:1790946405.361954:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946405.362022:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1877943303298432:0@lo:400: 00000100:00100000:3.0:1790946405.362063:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946405.362093:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790946405.362099:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303298304:0@lo:400: 00000100:00100000:3.0:1790946405.362128:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946405.362168:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303298304 00000100:00100000:3.0:1790946405.362177:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303298304 00000100:00100000:3.0:1790946405.362275:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790946405.362287:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682eaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1877943303298304:12345-0@lo:400: 00000100:00100000:3.0:1790946405.362353:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682eaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1877943303298304:12345-0@lo:400: Request processed in 68us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946405.362361:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1790946405.362385:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790946405.362429:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146bee39180 x1877943303298304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790946421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946405.362445:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303298304:0@lo:400: 00000100:00100000:1.0:1790946405.362949:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877943303298048:0@lo:400: 00000100:00100000:1.0:1790946405.363012:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946405.363082:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303298560:0@lo:400: 00000100:00100000:1.0:1790946405.363121:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946405.363172:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790946405.363183:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1877943303298176:0@lo:400: 00000100:00100000:1.0:1790946405.363252:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946405.363285:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303298432 00000100:00100000:1.0:1790946405.363309:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303298432 00000100:00100000:1.0:1790946405.363355:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303298048 00000100:00100000:1.0:1790946405.363358:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303298048 00000100:00100000:1.0:1790946405.363371:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303298176 00000100:00100000:1.0:1790946405.363373:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303298176 00000100:00100000:1.0:1790946405.363387:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790946405.363394:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682eaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1877943303298432:12345-0@lo:400: 00000100:00100000:1.0:1790946405.363444:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682eaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1877943303298432:12345-0@lo:400: Request processed in 50us (1381us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946405.363450:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790946405.363468:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790946405.363473:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b68abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877943303298048:12345-0@lo:400: 00000100:00100000:1.0:1790946405.363500:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b68abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877943303298048:12345-0@lo:400: Request processed in 27us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946405.363506:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790946405.363518:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790946405.363523:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b68a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877943303298176:12345-0@lo:400: 00000100:00100000:1.0:1790946405.363548:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b68a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877943303298176:12345-0@lo:400: Request processed in 25us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946405.363555:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790946405.363573:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303298560 00000100:00100000:1.0:1790946405.363577:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303298560 00000100:00100000:1.0:1790946405.363602:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790946405.363609:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b68ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3302:x1877943303298560:12345-0@lo:400: 00000100:00100000:1.0:1790946405.363639:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b68ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3302:x1877943303298560:12345-0@lo:400: Request processed in 31us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946405.363645:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1790946405.363670:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790946405.363682:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1790946405.363712:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146bee3ad80 x1877943303298176/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946405.363727:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1877943303298176:0@lo:400: 00010000:00080000:1.0:1790946405.363738:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146bee3a680 x1877943303298048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946405.363759:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877943303298048:0@lo:400: 00010000:00080000:1.0:1790946405.363771:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146bee3a300 x1877943303298560/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790946421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946405.363781:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303298560:0@lo:400: 00010000:00080000:1.0:1790946405.363823:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146bee38e00 x1877943303298432/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946405.363833:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1877943303298432:0@lo:400: 00000100:00100000:2.0:1790946405.364308:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303297920 00000100:00100000:2.0:1790946405.364317:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303297920 00000100:00100000:2.0:1790946405.364401:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1790946405.364410:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3301:x1877943303297920:12345-0@lo:400: 00000100:00100000:2.0:1790946405.364486:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3301:x1877943303297920:12345-0@lo:400: Request processed in 78us (2534us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946405.364493:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1790946405.364664:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3301:1877943303297920:0@lo:400: 00010000:00010000:2.0:1790946405.616817:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946405.876950:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790946405.876994:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bdcc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303298688:0@lo:13: 00000100:00100000:0.0:1790946405.877325:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946405.877417:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303298688 00000100:00100000:0.0:1790946405.877429:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303298688 00000100:00100000:0.0:1790946405.877494:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790946405.877506:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bdccb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1877943303298688:12345-0@lo:13: 00002000:00000024:0.0:1790946405.877557:0:6678:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790946405.877614:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bdccb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1877943303298688:12345-0@lo:13: Request processed in 110us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946405.877622:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1790946405.877678:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146bdcc8380 x1877943303298688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790946421 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946405.877702:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bdcc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303298688:0@lo:13: 00000001:00080000:3.0:1790946405.960041:0:7645:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:2.0:1790946406.640927:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946407.404083:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946407.404260:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286497664 00000100:00100000:2.0:1790946407.404276:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286497664 00000100:00100000:2.0:1790946407.404345:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 113 00000100:00100000:2.0:1790946407.404355:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2360:x1877943286497664:12345-192.168.203.13@tcp:250: 00010000:00080000:2.0:1790946407.404431:0:5829:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from ec4ece38-7293-498c-8428-4d215a1f0fd0@192.168.203.13@tcp t0 exp 0000000000000000 cur 192 last 0 00000020:00000080:2.0:1790946407.404473:0:5829:0:(genops.c:1384:class_connect()) connect: client ec4ece38-7293-498c-8428-4d215a1f0fd0, cookie 0x16e41aef93271c2e 00000100:00080000:2.0:1790946407.404654:0:5829:0:(import.c:65:import_set_state_nolock()) ffff914587bba800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790946407.404765:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+5:2360:x1877943286497664:12345-192.168.203.13@tcp:250: Request processed in 409us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946407.404775:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 113 00000100:00100000:0.0:1790946407.410889:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946407.412534:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286497536 00000100:00100000:3.0:1790946407.412555:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286497536 00000100:00100000:3.0:1790946407.412712:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 114 00000100:00100000:3.0:1790946407.412725:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec4ece38-7293-498c-8428-4d215a1f0fd0+5:5588:x1877943286497536:12345-192.168.203.13@tcp:101: 00010000:00010000:3.0:1790946407.412756:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946407.412782:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9146a032ac00/0x16e41aef93271c35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cb47 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946407.412844:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9146a032ac00/0x16e41aef93271c35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cb47 expref: 6 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946407.412858:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9146a032ac00/0x16e41aef93271c35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cb47 expref: 6 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946407.412870:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146a032ac00, rc 0) 00000100:00100000:3.0:1790946407.412977:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec4ece38-7293-498c-8428-4d215a1f0fd0+6:5588:x1877943286497536:12345-192.168.203.13@tcp:101: Request processed in 254us (2104us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946407.412984:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 114 00000100:00100000:1.0:1790946407.422530:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946407.428821:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286497792 00000100:00100000:3.0:1790946407.428844:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286497792 00000100:00100000:3.0:1790946407.429043:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 115 00000100:00100000:3.0:1790946407.429056:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+6:5588:x1877943286497792:12345-192.168.203.13@tcp:501: 00000100:00100000:3.0:1790946407.432791:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+6:5588:x1877943286497792:12345-192.168.203.13@tcp:501: Request processed in 3721us (10262us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790946407.432812:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 115 00000100:00100000:2.0:1790946407.437868:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946407.437957:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286497920 00000100:00100000:3.0:1790946407.437981:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286497920 00000100:00100000:3.0:1790946407.438049:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 116 00000100:00100000:3.0:1790946407.438060:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec4ece38-7293-498c-8428-4d215a1f0fd0+6:5588:x1877943286497920:12345-192.168.203.13@tcp:101: 00010000:00010000:3.0:1790946407.438082:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946407.438115:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9146a032a600/0x16e41aef93271c3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cb4e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946407.438153:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9146a032a600/0x16e41aef93271c3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cb4e expref: 7 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946407.438187:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9146a032a600/0x16e41aef93271c3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cb4e expref: 7 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946407.438198:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146a032a600, rc 0) 00000100:00100000:3.0:1790946407.438437:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec4ece38-7293-498c-8428-4d215a1f0fd0+7:5588:x1877943286497920:12345-192.168.203.13@tcp:101: Request processed in 379us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946407.438446:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 116 00000100:00100000:1.0:1790946407.443629:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946407.443689:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286498048 00000100:00100000:3.0:1790946407.443703:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286498048 00000100:00100000:3.0:1790946407.443786:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 117 00000100:00100000:3.0:1790946407.443797:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+7:5588:x1877943286498048:12345-192.168.203.13@tcp:501: 00000100:00100000:3.0:1790946407.444569:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+8:5588:x1877943286498048:12345-192.168.203.13@tcp:501: Request processed in 767us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946407.444580:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 117 00000100:00100000:1.0:1790946407.452018:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946407.452394:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286498176 00000100:00100000:0.0:1790946407.452408:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286498176 00000100:00100000:0.0:1790946407.452489:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 118 00000100:00100000:0.0:1790946407.452500:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468494e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec4ece38-7293-498c-8428-4d215a1f0fd0+8:5588:x1877943286498176:12345-192.168.203.13@tcp:503: 00000100:00100000:0.0:1790946407.453003:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468494e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec4ece38-7293-498c-8428-4d215a1f0fd0+8:5588:x1877943286498176:12345-192.168.203.13@tcp:503: Request processed in 502us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946407.453013:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 118 00000100:00100000:2.0:1790946407.461796:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946407.461990:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286498304 00000100:00100000:3.0:1790946407.462005:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286498304 00000100:00100000:3.0:1790946407.462091:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 119 00000100:00100000:3.0:1790946407.462103:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468494c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+8:5607:x1877943286498304:12345-192.168.203.13@tcp:502: 00000100:00100000:2.0:1790946407.466986:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468494c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+8:5607:x1877943286498304:12345-192.168.203.13@tcp:502: Request processed in 4868us (5186us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946407.467007:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 119 00000100:00100000:1.0:1790946407.501345:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946407.502858:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286498432 00000100:00100000:0.0:1790946407.502878:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286498432 00000100:00100000:0.0:1790946407.502971:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 120 00000100:00100000:0.0:1790946407.502984:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468494c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec4ece38-7293-498c-8428-4d215a1f0fd0+8:5607:x1877943286498432:12345-192.168.203.13@tcp:502: 00000100:00100000:0.0:1790946407.503438:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468494c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec4ece38-7293-498c-8428-4d215a1f0fd0+8:5607:x1877943286498432:12345-192.168.203.13@tcp:502: Request processed in 455us (2108us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946407.503458:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 120 00000100:00100000:1.0:1790946407.509885:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946407.510378:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286498560 00000100:00100000:2.0:1790946407.510395:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286498560 00000100:00100000:2.0:1790946407.510490:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 121 00000100:00100000:2.0:1790946407.510501:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468494e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+8:5588:x1877943286498560:12345-192.168.203.13@tcp:101: 00010000:00010000:2.0:1790946407.510525:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946407.510549:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff914688aef600/0x16e41aef93271c43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cb78 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946407.510588:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff914688aef600/0x16e41aef93271c43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cb78 expref: 9 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946407.510601:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff914688aef600/0x16e41aef93271c43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cb78 expref: 9 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946407.510612:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914688aef600, rc 0) 00000100:00100000:2.0:1790946407.510694:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468494e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+9:5588:x1877943286498560:12345-192.168.203.13@tcp:101: Request processed in 195us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946407.510741:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 121 00000100:00100000:1.0:1790946407.521154:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946407.521663:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286498688 00000100:00100000:2.0:1790946407.521678:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286498688 00000100:00100000:2.0:1790946407.521762:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 122 00000100:00100000:2.0:1790946407.521773:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468494e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec4ece38-7293-498c-8428-4d215a1f0fd0+9:5588:x1877943286498688:12345-192.168.203.13@tcp:256: 20000000:01000000:2.0:1790946407.521806:0:5828:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1790946407.521840:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1790946407.521844:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1790946407.521847:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1790946407.521850:0:5828:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1790946407.526846:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468494e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec4ece38-7293-498c-8428-4d215a1f0fd0+9:5588:x1877943286498688:12345-192.168.203.13@tcp:256: Request processed in 5055us (5762us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946407.526867:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 122 00000100:00100000:1.0:1790946407.534626:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946407.549754:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286498816 00000100:00100000:0.0:1790946407.549780:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286498816 00000100:00100000:0.0:1790946407.549880:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 123 00000100:00100000:0.0:1790946407.549893:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468494f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec4ece38-7293-498c-8428-4d215a1f0fd0+9:5588:x1877943286498816:12345-192.168.203.13@tcp:101: 00010000:00010000:0.0:1790946407.549917:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946407.550011:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff914680030a00/0x16e41aef93271c4a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cb7f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946407.550055:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff914680030a00/0x16e41aef93271c4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cb7f expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946407.550068:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff914680030a00/0x16e41aef93271c4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cb7f expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946407.550079:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914680030a00, rc 0) 00000100:00100000:0.0:1790946407.550472:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468494f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec4ece38-7293-498c-8428-4d215a1f0fd0+10:5588:x1877943286498816:12345-192.168.203.13@tcp:101: Request processed in 580us (15862us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946407.550481:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 123 00000100:00100000:1.0:1790946407.558034:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946407.558670:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286498944 00000100:00100000:2.0:1790946407.558688:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286498944 00000100:00100000:2.0:1790946407.558910:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 124 00000100:00100000:2.0:1790946407.558923:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468494d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec4ece38-7293-498c-8428-4d215a1f0fd0+10:5588:x1877943286498944:12345-192.168.203.13@tcp:501: 00000100:00100000:2.0:1790946407.559366:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468494d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec4ece38-7293-498c-8428-4d215a1f0fd0+10:5588:x1877943286498944:12345-192.168.203.13@tcp:501: Request processed in 443us (1344us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946407.559376:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 124 00000100:00100000:1.0:1790946407.566076:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946407.566271:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286499072 00000100:00100000:2.0:1790946407.566286:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286499072 00000100:00100000:2.0:1790946407.566360:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 125 00000100:00100000:2.0:1790946407.566371:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468494dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec4ece38-7293-498c-8428-4d215a1f0fd0+10:5588:x1877943286499072:12345-192.168.203.13@tcp:503: 00000100:00100000:2.0:1790946407.567023:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468494dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec4ece38-7293-498c-8428-4d215a1f0fd0+10:5588:x1877943286499072:12345-192.168.203.13@tcp:503: Request processed in 650us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946407.567048:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 125 00000100:00100000:1.0:1790946407.583865:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946407.584058:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286499200 00000100:00100000:0.0:1790946407.584073:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286499200 00000100:00100000:0.0:1790946407.584160:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 126 00000100:00100000:0.0:1790946407.584173:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468494cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec4ece38-7293-498c-8428-4d215a1f0fd0+10:5613:x1877943286499200:12345-192.168.203.13@tcp:502: 00000100:00100000:0.0:1790946407.584584:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468494cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec4ece38-7293-498c-8428-4d215a1f0fd0+10:5613:x1877943286499200:12345-192.168.203.13@tcp:502: Request processed in 413us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946407.584594:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 126 00000100:00100000:1.0:1790946407.590287:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946407.590772:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286499328 00000100:00100000:0.0:1790946407.590794:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286499328 00000100:00100000:0.0:1790946407.590870:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 127 00000100:00100000:0.0:1790946407.590882:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468494c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+10:5613:x1877943286499328:12345-192.168.203.13@tcp:502: 00000100:00100000:2.0:1790946407.591822:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468494c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+10:5613:x1877943286499328:12345-192.168.203.13@tcp:502: Request processed in 936us (1546us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946407.591835:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 127 00000100:00100000:1.0:1790946407.600067:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946407.600354:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286499456 00000100:00100000:2.0:1790946407.600370:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286499456 00000100:00100000:2.0:1790946407.600443:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:2.0:1790946407.600454:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914685635c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2360:x1877943286499456:12345-192.168.203.13@tcp:38: 00010000:00080000:2.0:1790946407.600495:0:5836:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 7eed1f4b-bd5b-4a70-8045-59db065b3dfc@192.168.203.13@tcp t0 exp 0000000000000000 cur 192 last 0 00000020:00000080:2.0:1790946407.600575:0:5836:0:(genops.c:1384:class_connect()) connect: client 7eed1f4b-bd5b-4a70-8045-59db065b3dfc, cookie 0x16e41aef93271c51 00000004:00100000:2.0:1790946407.600623:0:5836:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000001:00000004:2.0:1790946407.600634:0:5836:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:2.0:1790946407.666074:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790946407.693709:0:5836:0:(import.c:65:import_set_state_nolock()) ffff9146bed89800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790946407.694555:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914685635c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2360:x1877943286499456:12345-192.168.203.13@tcp:38: Request processed in 94095us (94497us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946407.694569:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:0.0:1790946407.920575:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303298816:0@lo:13: 00000100:00100000:0.0:1790946407.920711:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946407.922873:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303298816 00000100:00100000:1.0:1790946407.922886:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303298816 00000100:00100000:1.0:1790946407.923120:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790946407.923131:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bdcc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303298816:12345-0@lo:13: 00002000:00000024:1.0:1790946407.923170:0:6678:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1790946407.923633:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790946407.924775:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bdcc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303298816:12345-0@lo:13: Request processed in 1641us (4058us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946407.924786:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1790946407.925377:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146bee3bb80 x1877943303298816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790946423 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946407.925453:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303298816:0@lo:13: 00000100:00100000:3.0:1790946408.451975:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946408.452235:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286499712 00000100:00100000:1.0:1790946408.452246:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286499712 00000100:00100000:1.0:1790946408.452325:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:1.0:1790946408.452336:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682ead180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:5588:x1877943286499712:12345-192.168.203.13@tcp:41: 00000004:00000024:1.0:1790946408.452379:0:5835:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1790946408.452499:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682ead180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:5588:x1877943286499712:12345-192.168.203.13@tcp:41: Request processed in 164us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946408.452506:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00080000:3.0:1790946408.453019:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790946408.462007:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946408.462055:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946408.462337:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286499584 00000100:00100000:3.0:1790946408.462347:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286499584 00000100:00100000:3.0:1790946408.462406:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286499840 00000100:00100000:3.0:1790946408.462410:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286499840 00000100:00100000:3.0:1790946408.462438:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:3.0:1790946408.462447:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+7:0:x1877943286499584:12345-192.168.203.13@tcp:41: 00000004:00000024:3.0:1790946408.462493:0:5836:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1790946408.462572:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+7:0:x1877943286499584:12345-192.168.203.13@tcp:41: Request processed in 125us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946408.462580:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:3.0:1790946408.462596:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:3.0:1790946408.462603:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:5588:x1877943286499840:12345-192.168.203.13@tcp:40: 00000100:00100000:3.0:1790946408.463168:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:5588:x1877943286499840:12345-192.168.203.13@tcp:40: Request processed in 563us (1110us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946408.463176:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:2.0:1790946408.474408:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946408.474470:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946408.474555:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286500352 00000100:00100000:3.0:1790946408.474565:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286500352 00000100:00100000:3.0:1790946408.474633:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 128 00000100:00100000:3.0:1790946408.474643:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682e30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec4ece38-7293-498c-8428-4d215a1f0fd0+10:2364:x1877943286500352:12345-192.168.203.13@tcp:400: 00000100:00100000:3.0:1790946408.474715:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682e30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec4ece38-7293-498c-8428-4d215a1f0fd0+10:2364:x1877943286500352:12345-192.168.203.13@tcp:400: Request processed in 74us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946408.474732:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 128 00000100:00100000:1.0:1790946408.474919:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286500224 00000100:00100000:1.0:1790946408.474924:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286500224 00000100:00100000:1.0:1790946408.474958:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:1.0:1790946408.474966:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:5588:x1877943286500224:12345-192.168.203.13@tcp:33: 00000100:00100000:1.0:1790946408.477917:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946408.477958:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946408.478001:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286499968 00000100:00100000:1.0:1790946408.478011:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286499968 00000100:00100000:1.0:1790946408.478043:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286500096 00000100:00100000:1.0:1790946408.478045:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286500096 00000100:00100000:1.0:1790946408.478065:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:1.0:1790946408.478073:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914685635500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2360:x1877943286499968:12345-192.168.203.13@tcp:8: 00010000:00080000:1.0:1790946408.478103:0:6675:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 7eed1f4b-bd5b-4a70-8045-59db065b3dfc@192.168.203.13@tcp t0 exp 0000000000000000 cur 193 last 0 00000020:00000080:1.0:1790946408.478310:0:6675:0:(genops.c:1384:class_connect()) connect: client 7eed1f4b-bd5b-4a70-8045-59db065b3dfc, cookie 0x16e41aef93271c58 00002000:00100000:1.0:1790946408.478322:0:6675:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7eed1f4b-bd5b-4a70-8045-59db065b3dfc/ffff9146bed8a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1790946408.478334:0:6675:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00000100:00100000:3.0:1790946408.478736:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:3.0:1790946408.478743:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914685636d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2360:x1877943286500096:12345-192.168.203.13@tcp:8: 00010000:00080000:3.0:1790946408.478763:0:6674:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 7eed1f4b-bd5b-4a70-8045-59db065b3dfc@192.168.203.13@tcp t0 exp 0000000000000000 cur 193 last 0 00000020:00000080:3.0:1790946408.478780:0:6674:0:(genops.c:1384:class_connect()) connect: client 7eed1f4b-bd5b-4a70-8045-59db065b3dfc, cookie 0x16e41aef93271c5f 00002000:00100000:3.0:1790946408.478785:0:6674:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7eed1f4b-bd5b-4a70-8045-59db065b3dfc/ffff914586f26000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1790946408.478801:0:6674:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:3.0:1790946408.479015:0:6674:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1790946408.479044:0:6674:0:(import.c:65:import_set_state_nolock()) ffff914586f25800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790946408.480440:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914685636d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2360:x1877943286500096:12345-192.168.203.13@tcp:8: Request processed in 1687us (2472us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946408.480451:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 9 00002000:00080000:1.0:1790946408.481375:0:6675:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1790946408.481413:0:6675:0:(import.c:65:import_set_state_nolock()) ffff9146bed8d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790946408.481491:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914685635500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2360:x1877943286499968:12345-192.168.203.13@tcp:8: Request processed in 3417us (3582us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946408.481500:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 8 00000004:00080000:1.0:1790946408.506162:0:5837:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 31140us 00000004:00200000:2.0:1790946408.549539:0:5837:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1790946408.550091:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:5588:x1877943286500224:12345-192.168.203.13@tcp:33: Request processed in 75120us (75684us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946408.550107:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 0 00010000:00010000:2.0:1790946408.689352:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946408.838735:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946408.838826:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286500480 00000100:00100000:0.0:1790946408.838839:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286500480 00000100:00100000:0.0:1790946408.838912:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:0.0:1790946408.838922:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:5630:x1877943286500480:12345-192.168.203.13@tcp:101: 00010000:00010000:0.0:1790946408.838944:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946408.839011:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914680031e00/0x16e41aef93271c66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cba9 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946408.839074:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff914680031200/0x16e41aef93271c6d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946408.839089:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914680031200/0x16e41aef93271c6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946408.839103:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914680031200/0x16e41aef93271c6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790946408.839137:0:5835:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790946408.839141:0:5835:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790946408.839157:0:5835:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff914680031200/0x16e41aef93271c6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946408.839193:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914680031e00/0x16e41aef93271c66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cba9 expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946408.839243:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff914680031200/0x16e41aef93271c6d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cba9 expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946408.839252:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff914686750d00) 00010000:00010000:0.0:1790946408.839255:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790946408.839258:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914680031200, rc 0) 00000100:00100000:0.0:1790946408.839551:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+7:5630:x1877943286500480:12345-192.168.203.13@tcp:101: Request processed in 628us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946408.839558:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 8 00010000:00010000:2.0:1790946409.712681:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946410.480473:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bdcc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1877943303299200:0@lo:400: 00000100:00100000:0.0:1790946410.480585:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946410.480830:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bdcc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303299328:0@lo:400: 00000100:00100000:1.0:1790946410.480928:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bdccaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877943303299072:0@lo:400: 00000100:00100000:3.0:1790946410.481006:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bdcca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3301:1877943303298944:0@lo:400: 00000100:00100000:2.0:1790946410.483574:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946410.485845:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303299328 00000100:00100000:2.0:1790946410.485860:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303299328 00000100:00100000:1.0:1790946410.485988:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946410.486023:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bdcc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303299584:0@lo:400: 00000100:00100000:1.0:1790946410.486065:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946410.486116:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303299200 00000100:00100000:1.0:1790946410.486120:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303299200 00000100:00100000:2.0:1790946410.486154:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303299584 00000100:00100000:1.0:1790946410.486159:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303299072 00000100:00100000:2.0:1790946410.486161:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303299584 00000100:00100000:1.0:1790946410.486164:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303299072 00000100:00100000:1.0:1790946410.486219:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790946410.486224:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790946410.486231:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b631b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1877943303299200:12345-0@lo:400: 00000100:00100000:2.0:1790946410.486238:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303299328:12345-0@lo:400: 00000100:00100000:1.0:1790946410.486303:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b631b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1877943303299200:12345-0@lo:400: Request processed in 75us (5719us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946410.486312:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790946410.486317:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303299328:12345-0@lo:400: Request processed in 82us (2749us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946410.486326:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790946410.486335:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790946410.486344:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914685637b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877943303299072:12345-0@lo:400: 00000100:00100000:2.0:1790946410.486349:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790946410.486360:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914685637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303299584:12345-0@lo:400: 00000100:00100000:3.0:1790946410.487782:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946410.487841:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bdcc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1877943303299456:0@lo:400: 00000100:00100000:3.0:1790946410.487880:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790946410.487944:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790946410.487951:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790946410.487953:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790946410.488095:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146bdcc8700 x1877943303299328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790946426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946410.488110:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bdcc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303299328:0@lo:400: 00000100:00100000:3.0:1790946410.488155:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303299456 00000100:00100000:3.0:1790946410.488161:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303299456 00000100:00100000:3.0:1790946410.488219:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790946410.488228:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682eace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1877943303299456:12345-0@lo:400: 00000100:00100000:3.0:1790946410.488278:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682eace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1877943303299456:12345-0@lo:400: Request processed in 51us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946410.488285:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1790946410.488304:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790946410.488332:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bdcc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1877943303299456:0@lo:400: 00000100:00100000:3.0:1790946410.488361:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303298944 00000100:00100000:3.0:1790946410.488365:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303298944 00000100:00100000:3.0:1790946410.488391:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1790946410.488398:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682e30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3301:x1877943303298944:12345-0@lo:400: 00000100:00100000:3.0:1790946410.488452:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682e30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3301:x1877943303298944:12345-0@lo:400: Request processed in 54us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946410.488459:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1790946410.488495:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914685637b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877943303299072:12345-0@lo:400: Request processed in 2149us (2506us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946410.488504:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bdcca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3301:1877943303298944:0@lo:400: 00000100:00100000:1.0:1790946410.488505:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790946410.490659:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914685637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303299584:12345-0@lo:400: Request processed in 4293us (4584us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946410.490674:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790946410.491415:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bdcc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1877943303299200:0@lo:400: 00000100:00100000:1.0:1790946410.496521:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bdccaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877943303299072:0@lo:400: 00010000:00080000:1.0:1790946410.496553:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146bdcc8e00 x1877943303299584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790946426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946410.496564:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1790946410.496583:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bdcc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303299584:0@lo:400: 00010000:00010000:2.0:1790946410.736782:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946410.992461:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b6319500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303299712:0@lo:13: 00000100:00100000:2.0:1790946410.992530:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946410.992656:0:6676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303299712 00000100:00100000:0.0:1790946410.992664:0:6676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303299712 00000100:00100000:0.0:1790946410.992724:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790946410.992734:0:6676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877943303299712:12345-0@lo:13: 00002000:00000024:0.0:1790946410.992770:0:6676:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790946410.992828:0:6676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877943303299712:12345-0@lo:13: Request processed in 96us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946410.992836:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1790946410.992906:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146b6319500 x1877943303299712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790946426 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946410.992923:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b6319500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303299712:0@lo:13: 00000100:00100000:0.0:1790946411.035636:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946411.035731:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286500608 00000100:00100000:3.0:1790946411.035741:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286500608 00000100:00100000:3.0:1790946411.035878:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:3.0:1790946411.035889:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b6319f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+7:5683:x1877943286500608:12345-192.168.203.13@tcp:41: 00000004:00000024:3.0:1790946411.035933:0:6803:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1790946411.036008:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b6319f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+7:5683:x1877943286500608:12345-192.168.203.13@tcp:41: Request processed in 121us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946411.036016:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00080000:0.0:1790946411.036256:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790946411.039685:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946411.039800:0:6676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286500736 00000100:00100000:0.0:1790946411.039821:0:6676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286500736 00000100:00100000:0.0:1790946411.039895:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:0.0:1790946411.039905:0:6676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682eac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:5683:x1877943286500736:12345-192.168.203.13@tcp:13: 00002000:00000024:0.0:1790946411.039948:0:6676:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790946411.040015:0:6676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682eac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:5683:x1877943286500736:12345-192.168.203.13@tcp:13: Request processed in 111us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946411.040023:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00080000:3.0:1790946411.041107:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790946411.043157:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946411.043263:0:6676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286500864 00000100:00100000:0.0:1790946411.043272:0:6676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286500864 00000100:00100000:0.0:1790946411.043339:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:0.0:1790946411.043349:0:6676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:5683:x1877943286500864:12345-192.168.203.13@tcp:13: 00002000:00000024:0.0:1790946411.043436:0:6676:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1790946411.043569:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790946411.043608:0:6676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:5683:x1877943286500864:12345-192.168.203.13@tcp:13: Request processed in 260us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946411.043615:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 11 00010000:00010000:2.0:1790946411.760806:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1790946412.071714:0:7645:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7eed1f4b-bd5b-4a70-8045-59db065b3dfc 00000001:00100000:3.0:1790946412.095802:0:6700:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7eed1f4b-bd5b-4a70-8045-59db065b3dfc 00010000:00010000:2.0:1790946412.786552:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946413.041096:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790946413.041142:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303299840:0@lo:13: 00000100:00100000:1.0:1790946413.041295:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946413.042680:0:6676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303299840 00000100:00100000:0.0:1790946413.042706:0:6676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303299840 00000100:00100000:0.0:1790946413.042909:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790946413.042922:0:6676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914685635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1877943303299840:12345-0@lo:13: 00002000:00000024:0.0:1790946413.042971:0:6676:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790946413.043070:0:6676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914685635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1877943303299840:12345-0@lo:13: Request processed in 150us (1776us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946413.043078:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1790946413.043183:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146bee39500 x1877943303299840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790946429 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946413.043244:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303299840:0@lo:13: 00000100:00080000:1.0:1790946413.045664:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1790946413.132914:0:5857:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7eed1f4b-bd5b-4a70-8045-59db065b3dfc 00000001:02000400:1.0:1790946413.713992:0:8305:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1790946413.799088:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946413.799134:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946413.799169:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946413.799215:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946413.799252:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286500992 00000100:00100000:2.0:1790946413.799265:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286500992 00000100:00100000:2.0:1790946413.799326:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 130 00000100:00100000:2.0:1790946413.799347:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682e33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+10:2362:x1877943286500992:12345-192.168.203.13@tcp:400: 00000100:00100000:2.0:1790946413.799454:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682e33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+10:2362:x1877943286500992:12345-192.168.203.13@tcp:400: Request processed in 108us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946413.799465:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 130 00000100:00100000:3.0:1790946413.799470:0:6808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286501248 00000100:00100000:3.0:1790946413.799477:0:6808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286501248 00000100:00100000:3.0:1790946413.799528:0:6808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286501376 00000100:00100000:3.0:1790946413.799531:0:6808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286501376 00000100:00100000:3.0:1790946413.799559:0:6808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:3.0:1790946413.799569:0:6808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+5:2362:x1877943286501248:12345-192.168.203.13@tcp:400: 00000100:00100000:3.0:1790946413.799618:0:6808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+5:2362:x1877943286501248:12345-192.168.203.13@tcp:400: Request processed in 51us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946413.799632:0:6808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:3.0:1790946413.799648:0:6808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:3.0:1790946413.800130:0:6808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+5:2362:x1877943286501376:12345-192.168.203.13@tcp:400: 00000100:00100000:3.0:1790946413.800178:0:6808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+5:2362:x1877943286501376:12345-192.168.203.13@tcp:400: Request processed in 523us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946413.800185:0:6808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:3.0:1790946413.800226:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286501120 00000100:00100000:3.0:1790946413.800231:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286501120 00000100:00100000:3.0:1790946413.800261:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00100000:3.0:1790946413.800266:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2362:x1877943286501120:12345-192.168.203.13@tcp:400: 00000100:00100000:3.0:1790946413.800293:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2362:x1877943286501120:12345-192.168.203.13@tcp:400: Request processed in 26us (1123us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946413.800298:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00080000:1.0:1790946413.800869:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790946413.800877:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790946413.800880:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790946413.809377:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946414.832572:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946415.602241:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b631ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303300352:0@lo:400: 00000100:00100000:1.0:1790946415.602304:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b6318a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3301:1877943303299968:0@lo:400: 00000100:00100000:3.0:1790946415.603785:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b631b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877943303300096:0@lo:400: 00000100:00100000:2.0:1790946415.605312:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b631a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1877943303300224:0@lo:400: 00000100:00100000:0.0:1790946415.607220:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946415.607317:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303300352 00000100:00100000:0.0:1790946415.607329:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303300352 00000100:00100000:0.0:1790946415.607784:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790946415.607798:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b631a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303300352:12345-0@lo:400: 00000100:00100000:0.0:1790946415.607897:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b631a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303300352:12345-0@lo:400: Request processed in 103us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946415.607906:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1790946415.607992:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146b631ad80 x1877943303300352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790946431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946415.608009:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b631ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303300352:0@lo:400: 00000100:00080000:0.0:1790946415.608062:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790946415.611405:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946415.611522:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946415.611577:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b6318e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303300608:0@lo:400: 00000100:00100000:1.0:1790946415.611838:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b6319180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1877943303300480:0@lo:400: 00000100:00100000:1.0:1790946415.611883:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946415.611940:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303300096 00000100:00100000:1.0:1790946415.611951:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303300096 00000100:00100000:1.0:1790946415.612005:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303300480 00000100:00100000:1.0:1790946415.612008:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303300480 00000100:00100000:1.0:1790946415.612043:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790946415.612053:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682eaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877943303300096:12345-0@lo:400: 00000100:00100000:1.0:1790946415.612113:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682eaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877943303300096:12345-0@lo:400: Request processed in 61us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946415.612120:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790946415.612139:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790946415.612145:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914685637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1877943303300480:12345-0@lo:400: 00000100:00100000:3.0:1790946415.612179:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946415.612235:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303300608 00000100:00100000:3.0:1790946415.612239:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303300608 00000100:00100000:3.0:1790946415.612274:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790946415.612281:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bdcc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303300608:12345-0@lo:400: 00000100:00100000:3.0:1790946415.612313:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bdcc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303300608:12345-0@lo:400: Request processed in 33us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946415.612319:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1790946415.612412:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146b6318e00 x1877943303300608/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790946431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946415.612428:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b6318e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303300608:0@lo:400: 00000100:00100000:3.0:1790946415.612456:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b631b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877943303300096:0@lo:400: 00000100:00100000:2.0:1790946415.612709:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946415.614832:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914685637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1877943303300480:12345-0@lo:400: Request processed in 2675us (2937us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946415.614848:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790946415.614887:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303300224 00000100:00100000:1.0:1790946415.614897:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303300224 00000100:00100000:1.0:1790946415.614946:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790946415.614954:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1877943303300224:12345-0@lo:400: 00000100:00100000:1.0:1790946415.615056:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1877943303300224:12345-0@lo:400: Request processed in 102us (2348us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946415.615062:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790946415.615091:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303299968 00000100:00100000:1.0:1790946415.615095:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303299968 00000100:00100000:1.0:1790946415.615130:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1790946415.615134:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b631a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1877943303300224:0@lo:400: 00000100:00100000:1.0:1790946415.615140:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682e33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3301:x1877943303299968:12345-0@lo:400: 00000100:00100000:1.0:1790946415.615179:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682e33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3301:x1877943303299968:12345-0@lo:400: Request processed in 42us (3789us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946415.615196:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:1.0:1790946415.615254:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790946415.615262:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790946415.615289:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b6318a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3301:1877943303299968:0@lo:400: 00000100:00100000:1.0:1790946415.615303:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b6319180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1877943303300480:0@lo:400: 00010000:00010000:0.0:1790946415.856457:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946416.114714:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303300736:0@lo:13: 00000100:00100000:3.0:1790946416.114814:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946416.114961:0:6676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303300736 00000100:00100000:2.0:1790946416.114972:0:6676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303300736 00000100:00100000:2.0:1790946416.115039:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790946416.115050:0:6676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bdccaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877943303300736:12345-0@lo:13: 00002000:00000024:2.0:1790946416.115097:0:6676:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790946416.115164:0:6676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bdccaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877943303300736:12345-0@lo:13: Request processed in 115us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946416.115172:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1790946416.116439:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146bee3aa00 x1877943303300736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790946432 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946416.116472:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303300736:0@lo:13: 00010000:00010000:2.0:1790946416.881824:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1790946417.329751:0:8453:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff3c35e6b0 20000000:00000080:3.0:1790946417.329778:0:8453:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9146bee02800 uarg=0000000000000000 20000000:01000000:3.0:1790946417.329829:0:8453:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1790946417.329832:0:8453:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1790946417.329835:0:8453:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1790946417.329841:0:8453:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1790946417.329847:0:8453:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1790946417.329866:0:8453:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1790946417.329869:0:8453:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1790946417.332035:0:8453:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1790946417.332045:0:8453:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1790946417.333273:0:8454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1790946417.334560:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1790946417.334619:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1790946417.334790:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:3.0:1790946417.334808:0:8453:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1790946417.334811:0:8453:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1790946417.336625:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1790946417.337476:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1790946417.337533:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1790946417.337584:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:1.0:1790946417.337600:0:8453:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1790946417.337603:0:8453:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1790946417.341798:0:8456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1790946417.342724:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1790946417.342805:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1790946417.342845:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:3.0:1790946417.342861:0:8453:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1790946417.342864:0:8453:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1790946417.344461:0:8457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:0.0:1790946417.345090:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:0.0:1790946417.345165:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:0.0:1790946417.345243:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:0.0:1790946417.345266:0:8453:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1790946417.345291:0:8453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff914680031e00/0x16e41aef93271c74 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946417.345314:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff914680030e00/0x16e41aef93271b71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93271b6a expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946417.345561:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff914680031c00/0x16e41aef93271b9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93271b94 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946417.345570:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9146b180fc00/0x16e41aef93271bc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93271bbe expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946417.345587:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff914688aee000/0x16e41aef93271bd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93271bcc expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946417.345594:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff914688aee200/0x16e41aef93271be1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93271bda expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946417.345601:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff914688aee400/0x16e41aef93271bfd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93271bf6 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946417.345608:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff914688aef800/0x16e41aef93271c20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93271c19 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946417.345618:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9146a032ac00/0x16e41aef93271c35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cb47 expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946417.345625:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9146a032a600/0x16e41aef93271c3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cb4e expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946417.345634:0:8453:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff914680031e00/0x16e41aef93271c74 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946417.345693:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9146a032a600/0x16e41aef93271c3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cb4e expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946417.345709:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9146a032a600/0x16e41aef93271c3c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cb4e expref: 9 pid: 5828 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946417.345727:0:8453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b631ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1877943303300864:192.168.203.13@tcp:104: 00010000:00010000:0.0:1790946417.345859:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9146a032ac00/0x16e41aef93271c35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cb47 expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946417.345873:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9146a032ac00/0x16e41aef93271c35 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cb47 expref: 9 pid: 5828 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946417.345883:0:8453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b631bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1877943303300992:192.168.203.13@tcp:104: 00010000:00010000:0.0:1790946417.345915:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff914688aef800/0x16e41aef93271c20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x16e41aef93271c19 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946417.345923:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff914688aef800/0x16e41aef93271c20 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x16e41aef93271c19 expref: 18 pid: 5829 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946417.345933:0:8453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b6319880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1877943303301120:0@lo:104: 00000100:00100000:0.0:1790946417.346463:0:8453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790946417.346503:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff914688aee400/0x16e41aef93271bfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x16e41aef93271bf6 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946417.346514:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff914688aee400/0x16e41aef93271bfd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x16e41aef93271bf6 expref: 18 pid: 5828 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946417.346525:0:8453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b6319c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1877943303301248:0@lo:104: 00000100:00100000:0.0:1790946417.346556:0:8453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790946417.346587:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff914688aee200/0x16e41aef93271be1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x16e41aef93271bda expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946417.346607:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff914688aee200/0x16e41aef93271be1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x16e41aef93271bda expref: 18 pid: 5827 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946417.346615:0:8453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b6318700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1877943303301376:0@lo:104: 00010000:00010000:0.0:1790946417.346641:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff914688aee000/0x16e41aef93271bd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x16e41aef93271bcc expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946417.346668:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff914688aee000/0x16e41aef93271bd3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x16e41aef93271bcc expref: 18 pid: 5829 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946417.346677:0:8453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b631b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1877943303301504:0@lo:104: 00010000:00010000:0.0:1790946417.346704:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9146b180fc00/0x16e41aef93271bc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x16e41aef93271bbe expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946417.346711:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9146b180fc00/0x16e41aef93271bc5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x16e41aef93271bbe expref: 18 pid: 5828 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946417.346719:0:8453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b6318380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1877943303301632:0@lo:104: 00010000:00010000:0.0:1790946417.346744:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff914680031c00/0x16e41aef93271b9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x16e41aef93271b94 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946417.346752:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff914680031c00/0x16e41aef93271b9b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x16e41aef93271b94 expref: 18 pid: 5828 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946417.346760:0:8453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b6318000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1877943303301760:0@lo:104: 00010000:00010000:0.0:1790946417.346784:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff914680030e00/0x16e41aef93271b71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x16e41aef93271b6a expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946417.346792:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff914680030e00/0x16e41aef93271b71 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x16e41aef93271b6a expref: 18 pid: 5827 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946417.346800:0:8453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b6319180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1877943303301888:0@lo:104: 00000100:00100000:0.0:1790946417.346817:0:8453:0:(client.c:2716:ptlrpc_set_wait()) set ffff914698bb6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790946417.346914:0:5818:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1790946417.346934:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946417.346970:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946417.346977:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946417.346985:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946417.346992:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946417.347001:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303301120 00000100:00100000:2.0:1790946417.347018:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303301120 00000100:00100000:2.0:1790946417.347069:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303301248 00000100:00100000:2.0:1790946417.347072:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303301248 00000100:00100000:2.0:1790946417.347081:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303301376 00000100:00100000:2.0:1790946417.347090:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303301376 00000100:00100000:2.0:1790946417.347102:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303301504 00000100:00100000:2.0:1790946417.347104:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303301504 00000100:00100000:2.0:1790946417.347112:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303301632 00000100:00100000:2.0:1790946417.347114:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303301632 00000100:00100000:2.0:1790946417.347122:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303301760 00000100:00100000:2.0:1790946417.347123:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303301760 00000100:00100000:2.0:1790946417.347131:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303301888 00000100:00100000:2.0:1790946417.347134:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303301888 00000100:00100000:2.0:1790946417.347146:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790946417.347155:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b631aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+9:8453:x1877943303301120:12345-0@lo:104: 00010000:00010000:2.0:1790946417.347171:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff914688aef400/0x16e41aef93271c19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93271c20 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946417.347260:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790946417.347267:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b631aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+9:8453:x1877943303301120:12345-0@lo:104: Request processed in 112us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946417.347275:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790946417.347300:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790946417.347307:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee00050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+8:8453:x1877943303301248:12345-0@lo:104: 00010000:00010000:2.0:1790946417.347316:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff914688aefc00/0x16e41aef93271bf6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93271bfd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946417.347367:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790946417.347372:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee00050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+8:8453:x1877943303301248:12345-0@lo:104: Request processed in 66us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946417.347378:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790946417.347424:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790946417.347431:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+7:8453:x1877943303301376:12345-0@lo:104: 00010000:00010000:2.0:1790946417.347447:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff914680030c00/0x16e41aef93271bda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93271be1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946417.347474:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1790946417.347479:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+7:8453:x1877943303301376:12345-0@lo:104: Request processed in 50us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946417.347484:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790946417.347495:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790946417.347501:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee38700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+6:8453:x1877943303301504:12345-0@lo:104: 00010000:00010000:2.0:1790946417.347508:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9146b180fa00/0x16e41aef93271bcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93271bd3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946417.347532:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1790946417.347536:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee38700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+6:8453:x1877943303301504:12345-0@lo:104: Request processed in 36us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946417.347543:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790946417.347553:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790946417.347559:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+5:8453:x1877943303301632:12345-0@lo:104: 00010000:00010000:2.0:1790946417.347566:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff914688aee800/0x16e41aef93271bbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93271bc5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946417.347590:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1790946417.347594:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+5:8453:x1877943303301632:12345-0@lo:104: Request processed in 36us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946417.347599:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790946417.347610:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790946417.347616:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+4:8453:x1877943303301760:12345-0@lo:104: 00010000:00010000:2.0:1790946417.347630:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff914680031600/0x16e41aef93271b94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93271b9b expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946417.347668:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1790946417.347673:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+4:8453:x1877943303301760:12345-0@lo:104: Request processed in 58us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946417.347679:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790946417.347691:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790946417.347697:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee39500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+3:8453:x1877943303301888:12345-0@lo:104: 00010000:00010000:2.0:1790946417.347705:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9146a032ae00/0x16e41aef93271b6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93271b71 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946417.347730:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1790946417.347735:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee39500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+3:8453:x1877943303301888:12345-0@lo:104: Request processed in 39us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946417.347741:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1790946417.347763:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1790946417.347771:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff914688aef400/0x16e41aef93271c19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93271c20 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946417.347779:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aef400 already unused, calling callback (ffffffffc1d96c20) 10000000:00010000:2.0:1790946417.347783:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff914688aef400/0x16e41aef93271c19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x16e41aef93271c20 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946417.347793:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff914688aef400/0x16e41aef93271c19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x16e41aef93271c20 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790946417.347801:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff914688aef400/0x16e41aef93271c19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x16e41aef93271c20 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790946417.347815:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790946417.347852:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff914688aef400/0x16e41aef93271c19 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271c20 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946417.347859:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790946417.347888:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff914688aef400/0x16e41aef93271c19 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271c20 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946417.347896:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff914688aef400/0x16e41aef93271c19 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271c20 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946417.347912:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1790946417.347915:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff914688aefc00/0x16e41aef93271bf6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93271bfd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946417.347921:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aefc00 already unused, calling callback (ffffffffc1d96c20) 10000000:00010000:2.0:1790946417.347924:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff914688aefc00/0x16e41aef93271bf6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x16e41aef93271bfd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946417.347931:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff914688aefc00/0x16e41aef93271bf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x16e41aef93271bfd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790946417.347937:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff914688aefc00/0x16e41aef93271bf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x16e41aef93271bfd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790946417.347943:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790946417.347974:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff914688aefc00/0x16e41aef93271bf6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271bfd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946417.347981:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790946417.347993:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff914688aefc00/0x16e41aef93271bf6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271bfd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946417.347999:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff914688aefc00/0x16e41aef93271bf6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271bfd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946417.348008:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1790946417.348011:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff914680030c00/0x16e41aef93271bda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93271be1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946417.348017:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914680030c00 already unused, calling callback (ffffffffc1d96c20) 10000000:00010000:2.0:1790946417.348020:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff914680030c00/0x16e41aef93271bda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x16e41aef93271be1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946417.348026:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff914680030c00/0x16e41aef93271bda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x16e41aef93271be1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790946417.348033:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff914680030c00/0x16e41aef93271bda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x16e41aef93271be1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790946417.348038:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790946417.348050:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff914680030c00/0x16e41aef93271bda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271be1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946417.348055:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790946417.348073:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff914680030c00/0x16e41aef93271bda lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271be1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946417.348079:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff914680030c00/0x16e41aef93271bda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271be1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946417.348089:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1790946417.348097:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9146b180fa00/0x16e41aef93271bcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93271bd3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946417.348103:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180fa00 already unused, calling callback (ffffffffc1d96c20) 10000000:00010000:2.0:1790946417.348106:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9146b180fa00/0x16e41aef93271bcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x16e41aef93271bd3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946417.348113:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9146b180fa00/0x16e41aef93271bcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x16e41aef93271bd3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790946417.348119:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9146b180fa00/0x16e41aef93271bcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x16e41aef93271bd3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790946417.348125:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790946417.348138:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9146b180fa00/0x16e41aef93271bcc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271bd3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946417.348144:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790946417.348150:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9146b180fa00/0x16e41aef93271bcc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271bd3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946417.348156:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9146b180fa00/0x16e41aef93271bcc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271bd3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946417.348166:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790946417.348169:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff914688aee800/0x16e41aef93271bbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93271bc5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946417.348174:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aee800 already unused, calling callback (ffffffffc1d96c20) 10000000:00010000:2.0:1790946417.348177:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff914688aee800/0x16e41aef93271bbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x16e41aef93271bc5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946417.348194:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff914688aee800/0x16e41aef93271bbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x16e41aef93271bc5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790946417.348227:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff914688aee800/0x16e41aef93271bbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x16e41aef93271bc5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790946417.348233:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790946417.348247:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff914688aee800/0x16e41aef93271bbe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271bc5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946417.348253:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790946417.348258:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff914688aee800/0x16e41aef93271bbe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271bc5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946417.348265:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff914688aee800/0x16e41aef93271bbe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271bc5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946417.348274:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790946417.348277:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff914680031600/0x16e41aef93271b94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93271b9b expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946417.348283:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914680031600 already unused, calling callback (ffffffffc1d96c20) 10000000:00010000:2.0:1790946417.348286:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff914680031600/0x16e41aef93271b94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x16e41aef93271b9b expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946417.348292:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff914680031600/0x16e41aef93271b94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x16e41aef93271b9b expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790946417.348299:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff914680031600/0x16e41aef93271b94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x16e41aef93271b9b expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790946417.348310:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790946417.348324:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff914680031600/0x16e41aef93271b94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271b9b expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946417.348330:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790946417.348334:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff914680031600/0x16e41aef93271b94 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271b9b expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946417.348341:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff914680031600/0x16e41aef93271b94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271b9b expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946417.348351:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946417.348355:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9146a032ae00/0x16e41aef93271b6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93271b71 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946417.348360:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146a032ae00 already unused, calling callback (ffffffffc1d96c20) 10000000:00010000:2.0:1790946417.348363:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9146a032ae00/0x16e41aef93271b6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x16e41aef93271b71 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946417.348369:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9146a032ae00/0x16e41aef93271b6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x16e41aef93271b71 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790946417.348375:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9146a032ae00/0x16e41aef93271b6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x16e41aef93271b71 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790946417.348380:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790946417.348390:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9146a032ae00/0x16e41aef93271b6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271b71 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946417.348395:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790946417.348405:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9146a032ae00/0x16e41aef93271b6a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271b71 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946417.348411:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9146a032ae00/0x16e41aef93271b6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271b71 expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946417.348425:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946417.348427:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946417.348429:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946417.348439:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946417.348467:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3300:1877943303302016:0@lo:103: 00000100:00100000:2.0:1790946417.348516:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946417.348546:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3300:1877943303302528:0@lo:103: 00000100:00100000:2.0:1790946417.348566:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946417.348590:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1790946417.348595:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3300:1877943303302144:0@lo:103: 00000100:00100000:2.0:1790946417.348616:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946417.348632:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3300:1877943303302656:0@lo:103: 00000100:00100000:2.0:1790946417.348651:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946417.348688:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3302:1877943303302272:0@lo:103: 00000100:00100000:2.0:1790946417.348713:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946417.348722:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3302:1877943303302784:0@lo:103: 00000100:00100000:2.0:1790946417.348741:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946417.348752:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790946417.348757:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3302:1877943303302400:0@lo:103: 00000100:00100000:2.0:1790946417.348781:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946417.348807:0:5821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303302016 00000100:00100000:2.0:1790946417.348822:0:5821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303302016 00010000:00010000:2.0:1790946417.348854:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff914688aef800/0x16e41aef93271c20 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef93271c19 expref: 19 pid: 5829 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946417.348875:0:5821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303302528 00000100:00100000:2.0:1790946417.348878:0:5821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303302528 00010000:00010000:2.0:1790946417.348892:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9146b180fc00/0x16e41aef93271bc5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef93271bbe expref: 20 pid: 5828 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946417.348903:0:5821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303302144 00000100:00100000:2.0:1790946417.348906:0:5821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303302144 00010000:00010000:2.0:1790946417.348917:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff914688aee400/0x16e41aef93271bfd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef93271bf6 expref: 21 pid: 5828 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946417.348927:0:5821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303302656 00000100:00100000:2.0:1790946417.348930:0:5821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303302656 00010000:00010000:2.0:1790946417.348940:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff914680031c00/0x16e41aef93271b9b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef93271b94 expref: 22 pid: 5828 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946417.348949:0:5821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303302272 00000100:00100000:2.0:1790946417.348952:0:5821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303302272 00010000:00010000:2.0:1790946417.348961:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff914688aee200/0x16e41aef93271be1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef93271bda expref: 23 pid: 5827 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946417.348972:0:5821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303302784 00000100:00100000:2.0:1790946417.348974:0:5821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303302784 00010000:00010000:2.0:1790946417.348985:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff914680030e00/0x16e41aef93271b71 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef93271b6a expref: 24 pid: 5827 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946417.348995:0:5821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303302400 00000100:00100000:2.0:1790946417.348997:0:5821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303302400 00010000:00010000:2.0:1790946417.349008:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff914688aee000/0x16e41aef93271bd3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef93271bcc expref: 25 pid: 5829 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946417.349036:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790946417.349044:0:5821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cfed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+25:3300:x1877943303302016:12345-0@lo:103: 00010000:00010000:2.0:1790946417.349059:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790946417.349064:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff914688aef800/0x16e41aef93271c20 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef93271c19 expref: 25 pid: 5829 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946417.349075:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff914688aef800/0x16e41aef93271c20 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x16e41aef93271c19 expref: 25 pid: 5829 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946417.349095:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790946417.349133:0:5821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cfed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+25:3300:x1877943303302016:12345-0@lo:103: Request processed in 90us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946417.349140:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790946417.349158:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790946417.349164:0:5821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cfd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+24:3300:x1877943303302528:12345-0@lo:103: 00010000:00010000:2.0:1790946417.349172:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790946417.349177:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9146b180fc00/0x16e41aef93271bc5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef93271bbe expref: 24 pid: 5828 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946417.349185:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9146b180fc00/0x16e41aef93271bc5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x16e41aef93271bbe expref: 24 pid: 5828 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946417.349196:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790946417.349246:0:5821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cfd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+24:3300:x1877943303302528:12345-0@lo:103: Request processed in 82us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946417.349252:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790946417.349265:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790946417.349278:0:5821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cfce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+23:3300:x1877943303302144:12345-0@lo:103: 00010000:00010000:2.0:1790946417.349286:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790946417.349290:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff914688aee400/0x16e41aef93271bfd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef93271bf6 expref: 23 pid: 5828 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946417.349299:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff914688aee400/0x16e41aef93271bfd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x16e41aef93271bf6 expref: 23 pid: 5828 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946417.349308:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790946417.349329:0:5821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cfce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+23:3300:x1877943303302144:12345-0@lo:103: Request processed in 52us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946417.349335:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790946417.349347:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790946417.349353:0:5821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cfe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+22:3300:x1877943303302656:12345-0@lo:103: 00010000:00010000:2.0:1790946417.349361:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790946417.349365:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff914680031c00/0x16e41aef93271b9b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef93271b94 expref: 22 pid: 5828 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946417.349373:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff914680031c00/0x16e41aef93271b9b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x16e41aef93271b94 expref: 22 pid: 5828 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946417.349382:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790946417.349404:0:5821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cfe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+22:3300:x1877943303302656:12345-0@lo:103: Request processed in 51us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946417.349410:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790946417.349421:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790946417.349427:0:5821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+21:3302:x1877943303302272:12345-0@lo:103: 00010000:00010000:2.0:1790946417.349434:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790946417.349444:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff914688aee200/0x16e41aef93271be1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef93271bda expref: 21 pid: 5827 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946417.349452:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff914688aee200/0x16e41aef93271be1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x16e41aef93271bda expref: 21 pid: 5827 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946417.349462:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790946417.349493:0:5821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+21:3302:x1877943303302272:12345-0@lo:103: Request processed in 66us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946417.349500:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790946417.349511:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790946417.349517:0:5821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cfd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+20:3302:x1877943303302784:12345-0@lo:103: 00010000:00010000:2.0:1790946417.349525:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790946417.349530:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff914680030e00/0x16e41aef93271b71 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef93271b6a expref: 20 pid: 5827 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946417.349538:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff914680030e00/0x16e41aef93271b71 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x16e41aef93271b6a expref: 20 pid: 5827 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946417.349547:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790946417.349569:0:5821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cfd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+20:3302:x1877943303302784:12345-0@lo:103: Request processed in 52us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946417.349575:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790946417.349587:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790946417.349593:0:5821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914685716450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3302:x1877943303302400:12345-0@lo:103: 00010000:00010000:2.0:1790946417.349602:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790946417.349606:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff914688aee000/0x16e41aef93271bd3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef93271bcc expref: 19 pid: 5829 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946417.349626:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff914688aee000/0x16e41aef93271bd3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x16e41aef93271bcc expref: 19 pid: 5829 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946417.349636:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790946417.349674:0:5821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914685716450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3302:x1877943303302400:12345-0@lo:103: Request processed in 67us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946417.349680:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790946417.349780:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3302:1877943303302400:0@lo:103: 00000100:00100000:2.0:1790946417.349791:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3302:1877943303302272:0@lo:103: 00000100:00100000:2.0:1790946417.349797:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3302:1877943303302784:0@lo:103: 00000100:00100000:2.0:1790946417.349835:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3300:1877943303302144:0@lo:103: 00000100:00100000:2.0:1790946417.349843:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3300:1877943303302656:0@lo:103: 00000100:00100000:2.0:1790946417.349850:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3300:1877943303302016:0@lo:103: 00000100:00100000:2.0:1790946417.349857:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3300:1877943303302528:0@lo:103: 00010000:00010000:0.0:1790946417.350420:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff914688aef800/0x16e41aef93271c20 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x16e41aef93271c19 expref: 18 pid: 5829 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946417.350455:0:8453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b6319880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1877943303301120:0@lo:104: 00010000:00010000:0.0:1790946417.350471:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff914688aee400/0x16e41aef93271bfd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x16e41aef93271bf6 expref: 17 pid: 5828 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946417.350480:0:8453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b6319c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1877943303301248:0@lo:104: 00010000:00010000:0.0:1790946417.350490:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff914688aee200/0x16e41aef93271be1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x16e41aef93271bda expref: 16 pid: 5827 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946417.350498:0:8453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b6318700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1877943303301376:0@lo:104: 00010000:00010000:0.0:1790946417.350508:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff914688aee000/0x16e41aef93271bd3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x16e41aef93271bcc expref: 15 pid: 5829 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946417.350516:0:8453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b631b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1877943303301504:0@lo:104: 00010000:00010000:0.0:1790946417.350527:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9146b180fc00/0x16e41aef93271bc5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x16e41aef93271bbe expref: 14 pid: 5828 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946417.350537:0:8453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b6318380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1877943303301632:0@lo:104: 00010000:00010000:0.0:1790946417.350547:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff914680031c00/0x16e41aef93271b9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x16e41aef93271b94 expref: 13 pid: 5828 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946417.350557:0:8453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b6318000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1877943303301760:0@lo:104: 00010000:00010000:0.0:1790946417.350567:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff914680030e00/0x16e41aef93271b71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x16e41aef93271b6a expref: 12 pid: 5827 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946417.350576:0:8453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b6319180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1877943303301888:0@lo:104: 00000100:00100000:2.0:1790946417.361618:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946417.361822:0:8453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b631ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1877943303300864:192.168.203.13@tcp:104: 00000100:00100000:0.0:1790946417.361858:0:8453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b631bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1877943303300992:192.168.203.13@tcp:104: 00010000:00010000:0.0:1790946417.361922:0:8453:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff914680031e00/0x16e41aef93271c74 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946417.362326:0:5821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286501504 00000100:00100000:3.0:1790946417.362337:0:5821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286501504 00010000:00010000:3.0:1790946417.362384:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9146a032a600/0x16e41aef93271c3c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cb4e expref: 10 pid: 5828 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946417.362425:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:3.0:1790946417.362436:0:5821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cfca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec4ece38-7293-498c-8428-4d215a1f0fd0+10:2363:x1877943286501504:12345-192.168.203.13@tcp:103: 00010000:00010000:3.0:1790946417.362455:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790946417.362462:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9146a032a600/0x16e41aef93271c3c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cb4e expref: 10 pid: 5828 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946417.362474:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9146a032a600/0x16e41aef93271c3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cb4e expref: 10 pid: 5828 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946417.362495:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9146a032a600/0x16e41aef93271c3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cb4e expref: 10 pid: 5828 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946417.362509:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790946417.363500:0:5821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cfca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec4ece38-7293-498c-8428-4d215a1f0fd0+9:2363:x1877943286501504:12345-192.168.203.13@tcp:103: Request processed in 1058us (1891us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946417.363512:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:2.0:1790946417.368262:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946417.368368:0:5820:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286501632 00000100:00100000:3.0:1790946417.368381:0:5820:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286501632 00010000:00010000:3.0:1790946417.368431:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9146a032ac00/0x16e41aef93271c35 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cb47 expref: 9 pid: 5828 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946417.368496:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:3.0:1790946417.368507:0:5820:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec4ece38-7293-498c-8428-4d215a1f0fd0+9:2364:x1877943286501632:12345-192.168.203.13@tcp:103: 00010000:00010000:3.0:1790946417.368528:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790946417.368534:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9146a032ac00/0x16e41aef93271c35 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cb47 expref: 9 pid: 5828 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946417.368548:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9146a032ac00/0x16e41aef93271c35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cb47 expref: 9 pid: 5828 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946417.368568:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9146a032ac00/0x16e41aef93271c35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cb47 expref: 9 pid: 5828 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946417.368589:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff914680031e00/0x16e41aef93271c74 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946417.368598:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff914680031e00/0x16e41aef93271c74 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946417.368616:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff914680031e00/0x16e41aef93271c74 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946417.368623:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff914680031e00/0x16e41aef93271c74 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946417.368630:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff914680031e00/0x16e41aef93271c74 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946417.368645:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff914680031e00/0x16e41aef93271c74 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946417.368671:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914680031e00 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:3.0:1790946417.368676:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff914680031e00/0x16e41aef93271c74 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946417.368685:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff914680031e00/0x16e41aef93271c74 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946417.368702:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff914680031e00/0x16e41aef93271c74 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946417.368716:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790946417.368783:0:5820:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec4ece38-7293-498c-8428-4d215a1f0fd0+8:2364:x1877943286501632:12345-192.168.203.13@tcp:103: Request processed in 278us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946417.368792:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 20 00010000:00010000:0.0:1790946417.369585:0:8453:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff914680031e00/0x16e41aef93271c74 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946417.369597:0:8453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff914680031e00/0x16e41aef93271c74 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946417.369604:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff914680031e00/0x16e41aef93271c74 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946417.904953:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946418.162196:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790946418.163073:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303302912:0@lo:13: 00000100:00100000:0.0:1790946418.163172:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946418.163286:0:6676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303302912 00000100:00100000:0.0:1790946418.163296:0:6676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303302912 00000100:00100000:0.0:1790946418.163364:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790946418.163375:0:6676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b631bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303302912:12345-0@lo:13: 00002000:00000024:0.0:1790946418.163424:0:6676:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790946418.163480:0:6676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b631bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303302912:12345-0@lo:13: Request processed in 106us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946418.163488:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1790946418.163898:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790946418.163947:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146c1cff480 x1877943303302912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790946434 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946418.165452:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303302912:0@lo:13: 10000000:01000000:2.0:1790946418.416540:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1790946418.416551:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9145853b6000 from 39 10000000:01000000:2.0:1790946418.416557:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790946418.416628:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff914688aee800/0x16e41aef93271c7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946418.416641:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff914688aee800/0x16e41aef93271c7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946418.416685:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff914688aee800/0x16e41aef93271c7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946418.416910:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cfe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303303040:0@lo:101: 00000100:00100000:2.0:1790946418.417015:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946418.417182:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146879a99c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790946418.418423:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303303040 00000100:00100000:3.0:1790946418.418442:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303303040 00000100:00100000:3.0:1790946418.418515:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1790946418.418525:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682e33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+12:5831:x1877943303303040:12345-0@lo:101: 00010000:00010000:3.0:1790946418.418546:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946418.418570:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9146a032b200/0x16e41aef93271c82 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x16e41aef93271c7b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946418.418603:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9146a032b200/0x16e41aef93271c82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x16e41aef93271c7b expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946418.418617:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9146a032b200/0x16e41aef93271c82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93271c7b expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946418.418627:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146a032b200, rc 0) 00000100:00100000:3.0:1790946418.418868:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682e33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+13:5831:x1877943303303040:12345-0@lo:101: Request processed in 343us (1858us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946418.418875:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1790946418.421605:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cfe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303303040:0@lo:101: 00010000:00010000:0.0:1790946418.421649:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff914688aee800/0x16e41aef93271c7b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271c82 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946418.421674:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff914688aee800/0x16e41aef93271c7b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93271c82 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946418.423014:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b631ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303303168:0@lo:501: 00000100:00100000:0.0:1790946418.423474:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946418.423609:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff914682df5e40 going to sleep for 11 seconds 00000100:00100000:1.0:1790946418.425386:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303303168 00000100:00100000:1.0:1790946418.425405:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303303168 00000100:00100000:1.0:1790946418.425490:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1790946418.425501:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682e32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+13:5831:x1877943303303168:12345-0@lo:501: 00000100:00100000:1.0:1790946418.426358:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682e32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+13:5831:x1877943303303168:12345-0@lo:501: Request processed in 855us (2882us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946418.426370:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1790946418.426481:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b631ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303303168:0@lo:501: 00000100:00100000:0.0:1790946418.426540:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b631ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303303296:0@lo:503: 00000100:00100000:0.0:1790946418.426597:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946418.426642:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff914682df5e40 going to sleep for 11 seconds 00000100:00100000:1.0:1790946418.426766:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303303296 00000100:00100000:1.0:1790946418.426772:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303303296 00000100:00100000:1.0:1790946418.426912:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1790946418.426921:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+13:5831:x1877943303303296:12345-0@lo:503: 00000100:00100000:1.0:1790946418.427148:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+13:5831:x1877943303303296:12345-0@lo:503: Request processed in 227us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946418.427162:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1790946418.427258:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b631ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303303296:0@lo:503: 00000100:00100000:0.0:1790946418.427946:0:8471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b631ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:8471:1877943303303424:0@lo:502: 00000100:00100000:0.0:1790946418.428007:0:8471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946418.428666:0:8471:0:(client.c:2716:ptlrpc_set_wait()) set ffff914682df5f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790946418.428929:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303303424 00000100:00100000:3.0:1790946418.428938:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303303424 00000100:00100000:3.0:1790946418.428986:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1790946418.428994:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+13:8471:x1877943303303424:12345-0@lo:502: 00000100:00100000:3.0:1790946418.429321:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+13:8471:x1877943303303424:12345-0@lo:502: Request processed in 327us (1314us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946418.429327:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1790946418.429563:0:8471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b631ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:8471:1877943303303424:0@lo:502: 00000100:00100000:0.0:1790946418.429623:0:8471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b631ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:8471:1877943303303552:0@lo:502: 00000100:00100000:0.0:1790946418.429674:0:8471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946418.429708:0:8471:0:(client.c:2716:ptlrpc_set_wait()) set ffff914684ac5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790946418.429893:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303303552 00000100:00100000:3.0:1790946418.429898:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303303552 00000100:00100000:3.0:1790946418.429922:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1790946418.429928:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+13:8471:x1877943303303552:12345-0@lo:502: 00000100:00100000:3.0:1790946418.430080:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+13:8471:x1877943303303552:12345-0@lo:502: Request processed in 152us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946418.430086:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1790946418.430231:0:8471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b631ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:8471:1877943303303552:0@lo:502: 00000040:00080000:0.0:1790946418.430258:0:8471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1790946418.430531:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1790946418.430554:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790946418.430565:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff914688aee800/0x16e41aef93271c7b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271c82 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946418.430578:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff914688aee800/0x16e41aef93271c7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271c82 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790946418.430588:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1790946418.430591:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1790946418.430593:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1790946418.430631:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146a032ac00/0x16e41aef93271c89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946418.430639:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9146a032ac00/0x16e41aef93271c89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946418.430659:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9146a032ac00/0x16e41aef93271c89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946418.430673:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bdcc9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303303680:0@lo:101: 00000100:00100000:3.0:1790946418.430714:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946418.430744:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146863d3300 going to sleep for 11 seconds 00000100:00100000:0.0:1790946418.430887:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303303680 00000100:00100000:0.0:1790946418.430893:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303303680 00000100:00100000:0.0:1790946418.430917:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1790946418.430923:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+13:5831:x1877943303303680:12345-0@lo:101: 00010000:00010000:0.0:1790946418.430935:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946418.430949:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff914680031c00/0x16e41aef93271c90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x16e41aef93271c89 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946418.430978:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff914680031c00/0x16e41aef93271c90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x16e41aef93271c89 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946418.430988:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff914680031c00/0x16e41aef93271c90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93271c89 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946418.430997:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914680031c00, rc 0) 00000100:00100000:0.0:1790946418.431035:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+14:5831:x1877943303303680:12345-0@lo:101: Request processed in 111us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946418.431041:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1790946418.431120:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bdcc9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303303680:0@lo:101: 00010000:00010000:3.0:1790946418.431134:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9146a032ac00/0x16e41aef93271c89 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271c90 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946418.431143:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9146a032ac00/0x16e41aef93271c89 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93271c90 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946418.431193:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bdcc9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303303808:0@lo:501: 00000100:00100000:3.0:1790946418.431265:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946418.431278:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146863d3300 going to sleep for 11 seconds 00000100:00100000:0.0:1790946418.431554:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303303808 00000100:00100000:0.0:1790946418.431560:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303303808 00000100:00100000:0.0:1790946418.431581:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1790946418.431588:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+14:5831:x1877943303303808:12345-0@lo:501: 00000100:00100000:0.0:1790946418.435752:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+14:5831:x1877943303303808:12345-0@lo:501: Request processed in 4151us (4472us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946418.435768:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1790946418.436145:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bdcc9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303303808:0@lo:501: 00000100:00100000:2.0:1790946418.436263:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cfd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303303936:0@lo:503: 00000100:00100000:2.0:1790946418.436332:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946418.436506:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146879a9780 going to sleep for 11 seconds 00000100:00100000:1.0:1790946418.436597:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303303936 00000100:00100000:1.0:1790946418.436607:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303303936 00000100:00100000:1.0:1790946418.436679:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1790946418.436691:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+14:5831:x1877943303303936:12345-0@lo:503: 00000100:00100000:1.0:1790946418.437143:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+14:5831:x1877943303303936:12345-0@lo:503: Request processed in 453us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946418.437151:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1790946418.437558:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cfd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303303936:0@lo:503: 00000100:00100000:1.0:1790946418.438435:0:8472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914685634e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:8472:1877943303304064:0@lo:502: 00000100:00100000:1.0:1790946418.438527:0:8472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946418.438609:0:8472:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146b602c840 going to sleep for 11 seconds 00000100:00100000:0.0:1790946418.438669:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303304064 00000100:00100000:0.0:1790946418.438678:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303304064 00000100:00100000:0.0:1790946418.438913:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1790946418.438926:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+14:8472:x1877943303304064:12345-0@lo:502: 00000100:00100000:0.0:1790946418.439493:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+14:8472:x1877943303304064:12345-0@lo:502: Request processed in 568us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946418.439502:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1790946418.439887:0:8472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914685634e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:8472:1877943303304064:0@lo:502: 00000020:01000000:2.0:1790946418.439928:0:8472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790946418.439940:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946418.439943:0:8472:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1790946418.439952:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1790946418.439992:0:8472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cfdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:8472:1877943303304192:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790946418.440044:0:8472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946418.440185:0:8472:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146879a9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790946418.440483:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303304192 00000100:00100000:0.0:1790946418.440491:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303304192 00000100:00100000:0.0:1790946418.440543:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1790946418.440560:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+14:8472:x1877943303304192:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790946418.440965:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+14:8472:x1877943303304192:12345-0@lo:502:llog_process_th.0 Request processed in 405us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946418.440974:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1790946418.441276:0:8472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cfdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:8472:1877943303304192:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790946418.441310:0:8472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790946418.441317:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946418.441320:0:8472:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1790946418.441326:0:8472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1790946418.442050:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1790946418.442081:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1790946418.442296:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146a032ac00/0x16e41aef93271c89 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271c90 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946418.442311:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9146a032ac00/0x16e41aef93271c89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271c90 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790946418.442342:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1790946418.442345:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9146be38b800 from 39 10000000:01000000:3.0:1790946418.442349:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790946418.442467:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146a032a600/0x16e41aef93271c97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946418.442478:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9146a032a600/0x16e41aef93271c97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946418.442490:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9146a032a600/0x16e41aef93271c97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946418.442521:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bdcca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303304320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790946418.442601:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946418.442670:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146863d3a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790946418.442912:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303304320 00000100:00100000:1.0:1790946418.442922:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303304320 00000100:00100000:1.0:1790946418.442983:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1790946418.442995:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+14:5831:x1877943303304320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790946418.443011:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946418.443028:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9146b180e000/0x16e41aef93271c9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x16e41aef93271c97 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946418.443057:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9146b180e000/0x16e41aef93271c9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x16e41aef93271c97 expref: 15 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946418.443069:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9146b180e000/0x16e41aef93271c9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93271c97 expref: 15 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946418.443079:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b180e000, rc 0) 00000100:00100000:1.0:1790946418.443328:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+15:5831:x1877943303304320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 334us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946418.443346:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1790946418.444006:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bdcca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303304320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790946418.444030:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9146a032a600/0x16e41aef93271c97 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271c9e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946418.444042:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9146a032a600/0x16e41aef93271c97 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93271c9e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946418.444490:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bdcca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303304448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790946418.444549:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946418.444635:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146863d3a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790946418.449932:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303304448 00000100:00100000:2.0:1790946418.449953:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303304448 00000100:00100000:2.0:1790946418.450090:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1790946418.450119:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+15:5831:x1877943303304448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790946418.450686:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+15:5831:x1877943303304448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 567us (6134us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946418.450695:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1790946418.453329:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bdcca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303304448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790946418.453435:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bdcca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303304576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790946418.453550:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946418.456855:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303304576 00000100:00100000:0.0:1790946418.456878:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303304576 00000100:00100000:3.0:1790946418.456881:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146863d3a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790946418.457292:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1790946418.457307:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+15:5831:x1877943303304576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790946418.462144:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+15:5831:x1877943303304576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 4830us (8583us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946418.462162:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1790946418.462394:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bdcca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303304576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790946418.463697:0:8473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914685634700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:8473:1877943303304704:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790946418.463802:0:8473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946418.463856:0:8473:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146b602cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1790946418.463925:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303304704 00000100:00100000:3.0:1790946418.463936:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303304704 00000100:00100000:3.0:1790946418.463995:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1790946418.464007:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+15:8473:x1877943303304704:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790946418.464358:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+15:8473:x1877943303304704:12345-0@lo:502:llog_process_th.0 Request processed in 352us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946418.464366:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1790946418.464483:0:8473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914685634700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:8473:1877943303304704:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790946418.464535:0:8473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914685634700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:8473:1877943303304832:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790946418.464570:0:8473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946418.464602:0:8473:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146b602cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1790946418.464716:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303304832 00000100:00100000:3.0:1790946418.464721:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303304832 00000100:00100000:3.0:1790946418.464744:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1790946418.464751:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+15:8473:x1877943303304832:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790946418.464904:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+15:8473:x1877943303304832:12345-0@lo:502:llog_process_th.0 Request processed in 152us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946418.464911:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1790946418.464996:0:8473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914685634700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:8473:1877943303304832:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1790946418.465016:0:8473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1790946418.465486:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1790946418.465512:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790946418.465526:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146a032a600/0x16e41aef93271c97 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271c9e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946418.465540:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9146a032a600/0x16e41aef93271c97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271c9e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790946418.465552:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1790946418.465555:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1790946418.465569:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1790946418.465605:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146a032aa00/0x16e41aef93271ca5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946418.465615:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9146a032aa00/0x16e41aef93271ca5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946418.465626:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9146a032aa00/0x16e41aef93271ca5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946418.465643:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bdcca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303304960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790946418.465697:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946418.465737:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146863d39c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790946418.465781:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303304960 00000100:00100000:2.0:1790946418.465789:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303304960 00000100:00100000:3.0:1790946418.465977:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1790946418.465987:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+15:5831:x1877943303304960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790946418.466002:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946418.466018:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9146a032b600/0x16e41aef93271cac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x16e41aef93271ca5 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946418.466045:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9146a032b600/0x16e41aef93271cac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x16e41aef93271ca5 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946418.466058:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9146a032b600/0x16e41aef93271cac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93271ca5 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946418.466068:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146a032b600, rc 0) 00000100:00100000:3.0:1790946418.466121:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+16:5831:x1877943303304960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946418.466128:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1790946418.466332:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bdcca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303304960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790946418.466350:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9146a032aa00/0x16e41aef93271ca5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271cac expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946418.466360:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9146a032aa00/0x16e41aef93271ca5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93271cac expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946418.466415:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b631ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303305088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790946418.466447:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946418.466473:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146b6571b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790946418.466695:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303305088 00000100:00100000:2.0:1790946418.466772:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303305088 00000100:00100000:2.0:1790946418.466799:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1790946418.466883:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+16:5831:x1877943303305088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790946418.467220:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+16:5831:x1877943303305088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 321us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946418.467228:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1790946418.467388:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b631ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303305088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790946418.467428:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b631ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303305216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790946418.467475:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946418.467505:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146b6571b40 going to sleep for 11 seconds 00000100:00100000:1.0:1790946418.467556:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303305216 00000100:00100000:1.0:1790946418.467561:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303305216 00000100:00100000:1.0:1790946418.467599:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1790946418.467608:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+16:5831:x1877943303305216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790946418.467801:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+16:5831:x1877943303305216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 194us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946418.467809:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1790946418.467918:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b631ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303305216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790946418.468443:0:8474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b631ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:8474:1877943303305344:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790946418.468491:0:8474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946418.468527:0:8474:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146b6571c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790946418.468576:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303305344 00000100:00100000:3.0:1790946418.468582:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303305344 00000100:00100000:3.0:1790946418.468620:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1790946418.468629:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+16:8474:x1877943303305344:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790946418.468838:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+16:8474:x1877943303305344:12345-0@lo:502:llog_process_th.0 Request processed in 209us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946418.468846:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1790946418.468960:0:8474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b631ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:8474:1877943303305344:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790946418.468986:0:8474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790946418.468999:0:8474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790946418.469002:0:8474:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1790946418.469010:0:8474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1790946418.469032:0:8474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b631ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:8474:1877943303305472:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790946418.469068:0:8474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946418.469086:0:8474:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146b6571c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790946418.471117:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303305472 00000100:00100000:2.0:1790946418.471137:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303305472 00000100:00100000:2.0:1790946418.471232:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1790946418.471246:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+16:8474:x1877943303305472:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790946418.471613:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+16:8474:x1877943303305472:12345-0@lo:502:llog_process_th.0 Request processed in 370us (2543us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946418.471622:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1790946418.472341:0:8474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b631ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:8474:1877943303305472:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790946418.472394:0:8474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790946418.472406:0:8474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790946418.472409:0:8474:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1790946418.472418:0:8474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:1.0:1790946418.479940:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1790946418.479991:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1790946418.480007:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146a032aa00/0x16e41aef93271ca5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271cac expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946418.480022:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9146a032aa00/0x16e41aef93271ca5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271cac expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790946418.480062:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1790946418.480066:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9146aa748800 from 39 10000000:01000000:1.0:1790946418.480069:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790946418.480120:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146b180ea00/0x16e41aef93271cb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946418.480130:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9146b180ea00/0x16e41aef93271cb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946418.480143:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9146b180ea00/0x16e41aef93271cb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946418.480175:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914685634700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303305600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790946418.480620:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946418.480681:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146b602c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790946418.480713:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303305600 00000100:00100000:3.0:1790946418.480725:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303305600 00000100:00100000:3.0:1790946418.480788:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1790946418.480799:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+16:5831:x1877943303305600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790946418.480824:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946418.480840:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9146a032ba00/0x16e41aef93271cba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x16e41aef93271cb3 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946418.480871:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9146a032ba00/0x16e41aef93271cba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x16e41aef93271cb3 expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946418.480883:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9146a032ba00/0x16e41aef93271cba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93271cb3 expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946418.480894:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146a032ba00, rc 0) 00000100:00100000:3.0:1790946418.480953:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+17:5831:x1877943303305600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946418.480960:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1790946418.481472:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914685634700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303305600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790946418.481498:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9146b180ea00/0x16e41aef93271cb3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271cba expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946418.481508:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9146b180ea00/0x16e41aef93271cb3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93271cba expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946418.481585:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914685634700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303305728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790946418.481738:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946418.481769:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146b602c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790946418.481786:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303305728 00000100:00100000:3.0:1790946418.481793:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303305728 00000100:00100000:3.0:1790946418.481910:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1790946418.481920:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+17:5831:x1877943303305728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790946418.484936:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+17:5831:x1877943303305728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3002us (3183us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946418.484955:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1790946418.485578:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914685634700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303305728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790946418.485733:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914685634700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303305856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790946418.485834:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946418.485929:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146b602c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790946418.486452:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303305856 00000100:00100000:2.0:1790946418.486463:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303305856 00000100:00100000:2.0:1790946418.486531:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1790946418.486543:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+17:5831:x1877943303305856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790946418.488040:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+17:5831:x1877943303305856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1489us (2196us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946418.488075:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1790946418.491671:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914685634700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303305856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790946418.492508:0:8475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cfdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:8475:1877943303305984:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790946418.492625:0:8475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946418.492680:0:8475:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146879a9480 going to sleep for 11 seconds 00000100:00100000:3.0:1790946418.493140:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303305984 00000100:00100000:3.0:1790946418.493150:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303305984 00000100:00100000:3.0:1790946418.493235:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1790946418.493247:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+17:8475:x1877943303305984:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790946418.493667:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+17:8475:x1877943303305984:12345-0@lo:502:llog_process_th.0 Request processed in 422us (1042us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946418.493676:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1790946418.493722:0:8475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cfdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:8475:1877943303305984:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790946418.493836:0:8475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cfdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:8475:1877943303306112:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790946418.493880:0:8475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946418.493917:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303306112 00000100:00100000:2.0:1790946418.493922:0:8475:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146879a9480 going to sleep for 11 seconds 00000100:00100000:3.0:1790946418.493923:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303306112 00000100:00100000:3.0:1790946418.493960:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1790946418.493968:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+17:8475:x1877943303306112:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790946418.495290:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+17:8475:x1877943303306112:12345-0@lo:502:llog_process_th.0 Request processed in 1316us (1403us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946418.495305:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1790946418.495513:0:8475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cfdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:8475:1877943303306112:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1790946418.495564:0:8475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1790946418.501254:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1790946418.501304:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790946418.501319:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146b180ea00/0x16e41aef93271cb3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271cba expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946418.501337:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9146b180ea00/0x16e41aef93271cb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271cba expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790946418.501505:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1790946418.501510:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1790946418.501514:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1790946418.501577:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff914680030000/0x16e41aef93271cc1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946418.501604:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff914680030000/0x16e41aef93271cc1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946418.501620:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff914680030000/0x16e41aef93271cc1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946418.501690:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b631ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303306240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790946418.501790:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946418.501855:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146b6571b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790946418.501936:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303306240 00000100:00100000:3.0:1790946418.501955:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303306240 00000100:00100000:3.0:1790946418.502017:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1790946418.502028:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+17:5831:x1877943303306240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790946418.502046:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946418.502063:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9146a032b000/0x16e41aef93271cc8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x16e41aef93271cc1 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946418.502094:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9146a032b000/0x16e41aef93271cc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x16e41aef93271cc1 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946418.502118:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9146a032b000/0x16e41aef93271cc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93271cc1 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946418.502128:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146a032b000, rc 0) 00000100:00100000:3.0:1790946418.502221:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+18:5831:x1877943303306240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946418.502229:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1790946418.505570:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b631ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303306240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790946418.505612:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff914680030000/0x16e41aef93271cc1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271cc8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946418.505627:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff914680030000/0x16e41aef93271cc1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93271cc8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946418.506981:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cfdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303306368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790946418.507075:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946418.507141:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146879a9480 going to sleep for 11 seconds 00000100:00100000:3.0:1790946418.508257:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303306368 00000100:00100000:3.0:1790946418.508272:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303306368 00000100:00100000:3.0:1790946418.508344:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1790946418.508509:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+18:5831:x1877943303306368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790946418.509078:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+18:5831:x1877943303306368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 723us (2001us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946418.509162:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1790946418.509458:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cfdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303306368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790946418.509532:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cfdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303306496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790946418.509594:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946418.509642:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146879a9480 going to sleep for 11 seconds 00000100:00100000:0.0:1790946418.509707:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303306496 00000100:00100000:0.0:1790946418.509716:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303306496 00000100:00100000:0.0:1790946418.509769:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1790946418.509779:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+18:5831:x1877943303306496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790946418.510016:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+18:5831:x1877943303306496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 238us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946418.510024:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1790946418.510497:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cfdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303306496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790946418.511043:0:8476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cfdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:8476:1877943303306624:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790946418.511114:0:8476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946418.511169:0:8476:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146879a9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790946418.511521:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303306624 00000100:00100000:3.0:1790946418.511531:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303306624 00000100:00100000:3.0:1790946418.511594:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1790946418.511604:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+18:8476:x1877943303306624:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790946418.512048:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+18:8476:x1877943303306624:12345-0@lo:502:llog_process_th.0 Request processed in 445us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946418.512056:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1790946418.512665:0:8476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cfdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:8476:1877943303306624:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790946418.512713:0:8476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790946418.512727:0:8476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946418.512730:0:8476:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1790946418.512741:0:8476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1790946418.512780:0:8476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cfdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:8476:1877943303306752:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790946418.512841:0:8476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946418.512891:0:8476:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146879a9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790946418.513400:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303306752 00000100:00100000:1.0:1790946418.513410:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303306752 00000100:00100000:1.0:1790946418.513477:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1790946418.513487:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+18:8476:x1877943303306752:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790946418.513802:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+18:8476:x1877943303306752:12345-0@lo:502:llog_process_th.0 Request processed in 316us (961us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946418.513810:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1790946418.514146:0:8476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cfdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:8476:1877943303306752:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790946418.514180:0:8476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790946418.514285:0:8476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946418.514289:0:8476:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1790946418.514297:0:8476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1790946418.514588:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1790946418.514685:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1790946418.514699:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff914680030000/0x16e41aef93271cc1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271cc8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946418.514712:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff914680030000/0x16e41aef93271cc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271cc8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790946418.514724:0:5831:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1790946418.514728:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff914682e5b380 from 1 10000000:01000000:0.0:1790946418.514731:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1790946418.514778:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff914680030e00/0x16e41aef93271ccf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946418.514788:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff914680030e00/0x16e41aef93271ccf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946418.514799:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff914680030e00/0x16e41aef93271ccf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946418.514835:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b6319180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303306880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790946418.514900:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946418.515067:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303306880 00000100:00100000:3.0:1790946418.515075:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303306880 00000100:00100000:3.0:1790946418.515134:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1790946418.515143:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+18:5831:x1877943303306880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790946418.515178:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946418.515383:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9146a032b800/0x16e41aef93271cd6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x16e41aef93271ccf expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946418.515413:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9146a032b800/0x16e41aef93271cd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x16e41aef93271ccf expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946418.515426:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9146a032b800/0x16e41aef93271cd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93271ccf expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946418.515435:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146a032b800, rc 0) 00000100:00100000:3.0:1790946418.515483:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:5831:x1877943303306880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 341us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946418.515490:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1790946418.515876:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146b65713c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790946418.515905:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b6319180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303306880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790946418.515927:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff914680030e00/0x16e41aef93271ccf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271cd6 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946418.516017:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff914680030e00/0x16e41aef93271ccf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93271cd6 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946418.516100:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b6319180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303307008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790946418.516145:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946418.516550:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146b65713c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790946418.516590:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303307008 00000100:00100000:3.0:1790946418.516678:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303307008 00000100:00100000:3.0:1790946418.516773:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1790946418.516784:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:5831:x1877943303307008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790946418.517144:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:5831:x1877943303307008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 361us (997us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790946418.517152:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1790946418.517292:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b6319180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303307008:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1790946418.517336:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1790946418.517347:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff914680030e00/0x16e41aef93271ccf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271cd6 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946418.517358:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff914680030e00/0x16e41aef93271ccf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271cd6 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946418.917947:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946418.918004:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946418.918041:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946418.918089:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946418.918245:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286502016 00000100:00100000:0.0:1790946418.918259:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286502016 00000100:00100000:0.0:1790946418.918333:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286502144 00000100:00100000:0.0:1790946418.918337:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286502144 00000100:00100000:0.0:1790946418.918370:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:0.0:1790946418.918399:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914685634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+5:2364:x1877943286502016:12345-192.168.203.13@tcp:400: 00000100:00100000:0.0:1790946418.918496:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914685634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+5:2364:x1877943286502016:12345-192.168.203.13@tcp:400: Request processed in 99us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946418.918506:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:0.0:1790946418.918528:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:0.0:1790946418.918535:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914685634380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+5:2364:x1877943286502144:12345-192.168.203.13@tcp:400: 00000100:00100000:0.0:1790946418.918562:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914685634380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+5:2364:x1877943286502144:12345-192.168.203.13@tcp:400: Request processed in 27us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946418.918569:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:3.0:1790946418.918832:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286501888 00000100:00100000:2.0:1790946418.918832:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286501760 00000100:00100000:2.0:1790946418.918841:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286501760 00000100:00100000:3.0:1790946418.918850:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286501888 00000100:00100000:2.0:1790946418.918902:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 164 00000100:00100000:2.0:1790946418.918915:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec4ece38-7293-498c-8428-4d215a1f0fd0+8:2364:x1877943286501760:12345-192.168.203.13@tcp:400: 00000100:00100000:3.0:1790946418.918939:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 26 00000100:00100000:3.0:1790946418.918953:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914685636680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2364:x1877943286501888:12345-192.168.203.13@tcp:400: 00000100:00100000:2.0:1790946418.918964:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec4ece38-7293-498c-8428-4d215a1f0fd0+8:2364:x1877943286501760:12345-192.168.203.13@tcp:400: Request processed in 50us (1030us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946418.918975:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 164 00000100:00100000:3.0:1790946418.919039:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914685636680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2364:x1877943286501888:12345-192.168.203.13@tcp:400: Request processed in 86us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946418.919066:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 26 00000100:00080000:1.0:1790946418.919260:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790946418.919267:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790946418.919270:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790946418.928592:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946419.952653:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946420.720669:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1877943303307264:0@lo:400:kworker.0 00000100:00100000:2.0:1790946420.720769:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946420.720841:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303307776:0@lo:400:kworker.0 00000100:00100000:2.0:1790946420.720873:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946420.720909:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1790946420.720916:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3301:1877943303307136:0@lo:400:kworker.0 00000100:00100000:2.0:1790946420.720954:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946420.720975:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1877943303307648:0@lo:400:kworker.0 00000100:00100000:1.0:1790946420.720977:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1877943303307392:0@lo:400:kworker.0 00000100:00100000:2.0:1790946420.721000:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946420.721036:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303307520:0@lo:400:kworker.0 00000100:00100000:2.0:1790946420.721060:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946420.721110:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303307136 00000100:00100000:2.0:1790946420.721132:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303307136 00000100:00100000:2.0:1790946420.721188:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1790946420.721198:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3301:x1877943303307136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946420.721290:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3301:x1877943303307136:12345-0@lo:400:kworker.0 Request processed in 93us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946420.721298:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1790946420.721360:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3301:1877943303307136:0@lo:400:kworker.0 00000100:00100000:2.0:1790946420.721404:0:6808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303307776 00000100:00100000:2.0:1790946420.721408:0:6808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303307776 00000100:00100000:1.0:1790946420.723415:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303307264 00000100:00100000:1.0:1790946420.723459:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303307264 00000100:00100000:1.0:1790946420.723662:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303307648 00000100:00100000:1.0:1790946420.723783:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303307648 00000100:00100000:1.0:1790946420.723822:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790946420.723832:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1877943303307264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946420.724448:0:6808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303307520 00000100:00100000:2.0:1790946420.724457:0:6808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303307520 00000100:00100000:2.0:1790946420.724494:0:6808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790946420.724506:0:6808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1877943303307776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946420.724858:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790946420.724869:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1877943303307520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946420.725267:0:6808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1877943303307776:12345-0@lo:400:kworker.0 Request processed in 763us (4391us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946420.725276:0:6808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1790946420.725347:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146c1cffb80 x1877943303307776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790946436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946420.725363:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303307776:0@lo:400:kworker.0 00000100:00100000:2.0:1790946420.725428:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790946420.725440:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1877943303307648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946420.725491:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1877943303307648:12345-0@lo:400:kworker.0 Request processed in 55us (4490us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946420.725497:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1790946420.725520:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790946420.725526:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790946420.725530:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790946420.725545:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946420.725587:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303307392 00000100:00100000:2.0:1790946420.725592:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303307392 00000100:00100000:2.0:1790946420.725705:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790946420.725711:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877943303307392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946420.725750:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877943303307392:12345-0@lo:400:kworker.0 Request processed in 38us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946420.725756:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1790946420.725770:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790946420.725790:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1877943303307392:0@lo:400:kworker.0 00000100:00100000:2.0:1790946420.725815:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1877943303307648:0@lo:400:kworker.0 00000100:00100000:3.0:1790946420.726510:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1877943303307520:12345-0@lo:400:kworker.0 Request processed in 1638us (5443us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946420.726523:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1790946420.726720:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146c1cfce00 x1877943303307520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790946436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946420.726734:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303307520:0@lo:400:kworker.0 00000100:00100000:1.0:1790946420.726857:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1877943303307264:12345-0@lo:400:kworker.0 Request processed in 3025us (6088us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946420.726867:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790946420.726944:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1877943303307264:0@lo:400:kworker.0 00000100:00100000:1.0:1790946420.772517:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946420.775437:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286502272 00000100:00100000:0.0:1790946420.775459:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286502272 00000100:00100000:0.0:1790946420.775789:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 166 00000100:00100000:0.0:1790946420.775803:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+8:5602:x1877943286502272:12345-192.168.203.13@tcp:101: 00010000:00010000:0.0:1790946420.775828:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946420.775851:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff914680031600/0x16e41aef93271cdd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cbb0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946420.775890:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff914680031600/0x16e41aef93271cdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cbb0 expref: 9 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946420.775903:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff914680031600/0x16e41aef93271cdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cbb0 expref: 9 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946420.775914:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914680031600, rc 0) 00000100:00100000:0.0:1790946420.776067:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+9:5602:x1877943286502272:12345-192.168.203.13@tcp:101: Request processed in 266us (3564us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946420.776075:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 166 00000100:00100000:2.0:1790946420.791573:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946420.791679:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286502400 00000100:00100000:0.0:1790946420.791693:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286502400 00000100:00100000:0.0:1790946420.791776:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 167 00000100:00100000:0.0:1790946420.791788:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec4ece38-7293-498c-8428-4d215a1f0fd0+9:5602:x1877943286502400:12345-192.168.203.13@tcp:501: 00000100:00100000:0.0:1790946420.792282:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec4ece38-7293-498c-8428-4d215a1f0fd0+9:5602:x1877943286502400:12345-192.168.203.13@tcp:501: Request processed in 493us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946420.792292:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 167 00000100:00100000:1.0:1790946420.798153:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946420.800460:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286502528 00000100:00100000:0.0:1790946420.800485:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286502528 00000100:00100000:0.0:1790946420.800679:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 168 00000100:00100000:0.0:1790946420.800692:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+9:5602:x1877943286502528:12345-192.168.203.13@tcp:503: 00000100:00100000:0.0:1790946420.801033:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+9:5602:x1877943286502528:12345-192.168.203.13@tcp:503: Request processed in 342us (3438us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946420.801042:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 168 00000100:00100000:1.0:1790946420.808500:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946420.809178:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286502656 00000100:00100000:0.0:1790946420.809197:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286502656 00000100:00100000:0.0:1790946420.809402:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 169 00000100:00100000:0.0:1790946420.809413:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec4ece38-7293-498c-8428-4d215a1f0fd0+9:6089:x1877943286502656:12345-192.168.203.13@tcp:502: 00000100:00100000:2.0:1790946420.816560:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec4ece38-7293-498c-8428-4d215a1f0fd0+9:6089:x1877943286502656:12345-192.168.203.13@tcp:502: Request processed in 7132us (8060us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946420.816579:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 169 00000100:00100000:3.0:1790946420.818804:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946420.822723:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286502784 00000100:00100000:0.0:1790946420.822747:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286502784 00000100:00100000:0.0:1790946420.822841:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 170 00000100:00100000:0.0:1790946420.822851:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+9:6089:x1877943286502784:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790946420.823239:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+9:6089:x1877943286502784:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 387us (4449us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946420.823249:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 170 00000100:00100000:1.0:1790946420.834421:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946420.834558:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286502912 00000100:00100000:0.0:1790946420.834593:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286502912 00000100:00100000:0.0:1790946420.834692:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 171 00000100:00100000:0.0:1790946420.834714:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+9:5602:x1877943286502912:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790946420.834738:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946420.834761:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff914680030c00/0x16e41aef93271ce4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cbb7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946420.834803:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff914680030c00/0x16e41aef93271ce4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cbb7 expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946420.834816:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff914680030c00/0x16e41aef93271ce4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cbb7 expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946420.834827:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914680030c00, rc 0) 00000100:00100000:0.0:1790946420.834927:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+10:5602:x1877943286502912:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 Request processed in 225us (1242us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946420.834935:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 171 00000100:00100000:1.0:1790946420.839292:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946420.840505:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286503040 00000100:00100000:2.0:1790946420.840524:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286503040 00000100:00100000:2.0:1790946420.840617:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 172 00000100:00100000:2.0:1790946420.840645:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec4ece38-7293-498c-8428-4d215a1f0fd0+10:5602:x1877943286503040:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790946420.841397:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec4ece38-7293-498c-8428-4d215a1f0fd0+10:5602:x1877943286503040:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 Request processed in 765us (2115us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790946420.841408:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 172 00010000:00010000:2.0:1790946420.977034:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946421.232663:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303307904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790946421.232771:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946421.233077:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303307904 00000100:00100000:1.0:1790946421.233090:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303307904 00000100:00100000:1.0:1790946421.233167:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790946421.233180:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b6319180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303307904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790946421.233270:0:6678:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790946421.233334:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b6319180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303307904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 157us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946421.233342:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1790946421.233496:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146c1cfed80 x1877943303307904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790946437 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946421.233521:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303307904:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790946422.007145:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790946422.556385:0:8514:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc1708c2e0 20000000:00000080:2.0:1790946422.556403:0:8514:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9146b660a000 uarg=0000000000000000 20000000:01000000:2.0:1790946422.556442:0:8514:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1790946422.556448:0:8514:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1790946422.556458:0:8514:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1790946422.557763:0:8515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1790946422.558133:0:8514:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1790946422.563993:0:8514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1790946422.564052:0:8514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1790946422.564112:0:8514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1790946422.564130:0:8514:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1790946422.564151:0:8514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff914688aef200/0x16e41aef93271ceb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946422.564170:0:8514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9146c20cb200/0x16e41aef93271a60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93271a59 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946422.564178:0:8514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9146c20caa00/0x16e41aef93271ac2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93271abb expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946422.564184:0:8514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff914680031a00/0x16e41aef93271b8d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93271b86 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946422.564194:0:8514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff914680030a00/0x16e41aef93271c4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cb7f expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946422.564222:0:8514:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff914688aef200/0x16e41aef93271ceb lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946422.564262:0:8514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff914680030a00/0x16e41aef93271c4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cb7f expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946422.564278:0:8514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff914680030a00/0x16e41aef93271c4a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cb7f expref: 9 pid: 5827 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946422.564354:0:8514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cfed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8514:1877943303308032:192.168.203.13@tcp:104: 00010000:00010000:2.0:1790946422.564472:0:8514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff914680031a00/0x16e41aef93271b8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x16e41aef93271b86 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946422.564491:0:8514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff914680031a00/0x16e41aef93271b8d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x16e41aef93271b86 expref: 18 pid: 5829 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946422.564500:0:8514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cfce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8514:1877943303308160:0@lo:104: 00000100:00100000:2.0:1790946422.564651:0:8514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790946422.564750:0:8514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9146c20caa00/0x16e41aef93271ac2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x16e41aef93271abb expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946422.564759:0:8514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9146c20caa00/0x16e41aef93271ac2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x16e41aef93271abb expref: 18 pid: 5828 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946422.564767:0:8514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cfd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8514:1877943303308288:0@lo:104: 00000100:00100000:2.0:1790946422.564806:0:8514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790946422.565022:0:8514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9146c20cb200/0x16e41aef93271a60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x16e41aef93271a59 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946422.565031:0:8514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9146c20cb200/0x16e41aef93271a60 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x16e41aef93271a59 expref: 18 pid: 5827 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946422.565039:0:8514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cfdf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8514:1877943303308416:0@lo:104: 00000100:00100000:2.0:1790946422.565057:0:8514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146879a96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790946422.565128:0:5818:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1790946422.565147:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946422.565172:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303308160 00000100:00100000:0.0:1790946422.565179:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303308160 00000100:00100000:0.0:1790946422.565256:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303308288 00000100:00100000:0.0:1790946422.565260:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303308288 00000100:00100000:0.0:1790946422.565271:0:5818:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303308416 00000100:00100000:0.0:1790946422.565273:0:5818:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303308416 00000100:00100000:0.0:1790946422.565287:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790946422.565296:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cfe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+5:8514:x1877943303308160:12345-0@lo:104: 00010000:00010000:0.0:1790946422.565316:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9146b180f800/0x16e41aef93271b86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93271b8d expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946422.565385:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790946422.565395:0:6689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b660b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+5:8514:x1877943303308288:12345-0@lo:104: 00010000:00010000:2.0:1790946422.565403:0:6689:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9146c20cb600/0x16e41aef93271abb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93271ac2 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946422.565454:0:5817:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/2 left), rc = 0 00000100:00100000:1.0:1790946422.565464:0:5817:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 3 min 2 max 56 00000100:00100000:1.0:1790946422.565470:0:5817:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_003' 00010000:00010000:0.0:1790946422.565835:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790946422.565842:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cfe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+5:8514:x1877943303308160:12345-0@lo:104: Request processed in 548us (1192us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946422.565850:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790946422.565868:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790946422.565874:0:5818:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b6318000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+4:8514:x1877943303308416:12345-0@lo:104: 00010000:00010000:0.0:1790946422.565882:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9146b1933200/0x16e41aef93271a59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93271a60 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946422.565913:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790946422.565927:0:5818:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b6318000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+4:8514:x1877943303308416:12345-0@lo:104: Request processed in 44us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946422.565933:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1790946422.565949:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790946422.565954:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9146b180f800/0x16e41aef93271b86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93271b8d expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946422.565962:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180f800 already unused, calling callback (ffffffffc1d96c20) 10000000:00010000:0.0:1790946422.565966:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9146b180f800/0x16e41aef93271b86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x16e41aef93271b8d expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946422.565975:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9146b180f800/0x16e41aef93271b86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x16e41aef93271b8d expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790946422.565982:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9146b180f800/0x16e41aef93271b86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x16e41aef93271b8d expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790946422.565995:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790946422.566022:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9146b180f800/0x16e41aef93271b86 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271b8d expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946422.566029:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790946422.566046:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9146b180f800/0x16e41aef93271b86 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271b8d expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946422.566053:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9146b180f800/0x16e41aef93271b86 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271b8d expref: -99 pid: 7629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946422.566065:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790946422.566069:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9146b1933200/0x16e41aef93271a59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93271a60 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946422.566074:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1933200 already unused, calling callback (ffffffffc1d96c20) 10000000:00010000:0.0:1790946422.566077:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9146b1933200/0x16e41aef93271a59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x16e41aef93271a60 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946422.566083:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9146b1933200/0x16e41aef93271a59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x16e41aef93271a60 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790946422.566089:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9146b1933200/0x16e41aef93271a59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x16e41aef93271a60 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790946422.566094:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790946422.566103:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9146b1933200/0x16e41aef93271a59 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271a60 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946422.566108:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790946422.566127:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9146b1933200/0x16e41aef93271a59 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271a60 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946422.566134:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9146b1933200/0x16e41aef93271a59 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271a60 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946422.566144:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946422.566146:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946422.566148:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946422.566162:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790946422.566173:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b6318380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3302:1877943303308544:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790946422.566223:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946422.566257:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b631b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3300:1877943303308672:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790946422.566280:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946422.566308:0:5819:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303308544 00000100:00100000:0.0:1790946422.566313:0:5819:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303308544 00010000:00010000:0.0:1790946422.566332:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff914680031a00/0x16e41aef93271b8d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef93271b86 expref: 19 pid: 5829 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946422.566352:0:5819:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303308672 00000100:00100000:0.0:1790946422.566354:0:5819:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303308672 00010000:00010000:0.0:1790946422.566364:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9146c20cb200/0x16e41aef93271a60 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef93271a59 expref: 20 pid: 5827 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946422.566374:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790946422.566381:0:5819:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b6318700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+20:3302:x1877943303308544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790946422.566391:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790946422.566395:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff914680031a00/0x16e41aef93271b8d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef93271b86 expref: 20 pid: 5829 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946422.566416:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff914680031a00/0x16e41aef93271b8d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x16e41aef93271b86 expref: 20 pid: 5829 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946422.566432:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790946422.566459:0:5819:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b6318700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+20:3302:x1877943303308544:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946422.566465:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790946422.566477:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790946422.566483:0:5819:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b6319c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3300:x1877943303308672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790946422.566490:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790946422.566494:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9146c20cb200/0x16e41aef93271a60 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef93271a59 expref: 19 pid: 5827 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946422.566753:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946422.566757:0:8514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff914680031a00/0x16e41aef93271b8d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x16e41aef93271b86 expref: 19 pid: 5829 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946422.566772:0:8514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cfce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8514:1877943303308160:0@lo:104: 00000100:00100000:3.0:1790946422.566784:0:8514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cfdf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8514:1877943303308416:0@lo:104: 00010000:00010000:0.0:1790946422.566861:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9146c20cb200/0x16e41aef93271a60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x16e41aef93271a59 expref: 18 pid: 5827 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946422.566874:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9146c20cb200/0x16e41aef93271a60 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x16e41aef93271a59 expref: 18 pid: 5827 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946422.566885:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790946422.566959:0:5819:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b6319c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+17:3300:x1877943303308672:12345-0@lo:103:ldlm_bl.0 Request processed in 476us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946422.566965:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790946422.567012:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b6318380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3302:1877943303308544:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790946422.567476:0:6689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790946422.567488:0:6689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b660b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+3:8514:x1877943303308288:12345-0@lo:104: Request processed in 2095us (2687us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946422.567495:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:2.0:1790946422.567587:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946422.567593:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9146c20cb600/0x16e41aef93271abb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93271ac2 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946422.567601:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146c20cb600 already unused, calling callback (ffffffffc1d96c20) 10000000:00010000:2.0:1790946422.567604:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9146c20cb600/0x16e41aef93271abb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x16e41aef93271ac2 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946422.567613:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9146c20cb600/0x16e41aef93271abb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x16e41aef93271ac2 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790946422.567629:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9146c20cb600/0x16e41aef93271abb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x16e41aef93271ac2 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790946422.567635:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790946422.567661:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9146c20cb600/0x16e41aef93271abb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271ac2 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946422.567667:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790946422.567678:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9146c20cb600/0x16e41aef93271abb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271ac2 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946422.567685:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9146c20cb600/0x16e41aef93271abb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271ac2 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946422.567697:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946422.567699:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946422.567701:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946422.567715:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3301:1877943303308800:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790946422.567743:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946422.567978:0:5820:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303308800 00000100:00100000:2.0:1790946422.567984:0:5820:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303308800 00010000:00010000:2.0:1790946422.568007:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9146c20caa00/0x16e41aef93271ac2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef93271abb expref: 17 pid: 5828 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946422.568030:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790946422.568036:0:5820:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+17:3301:x1877943303308800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790946422.568045:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790946422.568049:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9146c20caa00/0x16e41aef93271ac2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef93271abb expref: 17 pid: 5828 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946422.568058:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9146c20caa00/0x16e41aef93271ac2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x16e41aef93271abb expref: 17 pid: 5828 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946422.568069:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790946422.568096:0:5820:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+17:3301:x1877943303308800:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946422.568102:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790946422.568132:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3301:1877943303308800:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790946422.568636:0:8514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9146c20caa00/0x16e41aef93271ac2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x16e41aef93271abb expref: 16 pid: 5828 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946422.568650:0:8514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cfd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8514:1877943303308288:0@lo:104: 00000100:00100000:1.0:1790946422.568763:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b631b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3300:1877943303308672:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790946422.573861:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946422.573927:0:8514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cfed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8514:1877943303308032:192.168.203.13@tcp:104: 00010000:00010000:0.0:1790946422.574578:0:8514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff914688aef200/0x16e41aef93271ceb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946422.575094:0:5821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286503168 00000100:00100000:2.0:1790946422.575102:0:5821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286503168 00010000:00010000:2.0:1790946422.575138:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff914680030a00/0x16e41aef93271c4a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cb7f expref: 10 pid: 5827 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946422.575179:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00100000:2.0:1790946422.575189:0:5821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914685634e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec4ece38-7293-498c-8428-4d215a1f0fd0+10:2363:x1877943286503168:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790946422.575240:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790946422.575246:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff914680030a00/0x16e41aef93271c4a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cb7f expref: 10 pid: 5827 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946422.575259:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff914680030a00/0x16e41aef93271c4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cb7f expref: 10 pid: 5827 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946422.575276:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff914680030a00/0x16e41aef93271c4a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cb7f expref: 10 pid: 5827 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946422.575290:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff914688aef200/0x16e41aef93271ceb lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946422.575298:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff914688aef200/0x16e41aef93271ceb lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946422.575312:0:5821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff914688aef200/0x16e41aef93271ceb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946422.575318:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff914688aef200/0x16e41aef93271ceb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946422.575325:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff914688aef200/0x16e41aef93271ceb lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946422.575331:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff914688aef200/0x16e41aef93271ceb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946422.575337:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aef200 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:2.0:1790946422.575341:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff914688aef200/0x16e41aef93271ceb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946422.575359:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff914688aef200/0x16e41aef93271ceb lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946422.575375:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff914688aef200/0x16e41aef93271ceb lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946422.575385:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790946422.575440:0:5821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914685634e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec4ece38-7293-498c-8428-4d215a1f0fd0+9:2363:x1877943286503168:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 252us (1587us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946422.575448:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 24 00010000:00010000:0.0:1790946422.576510:0:8514:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff914688aef200/0x16e41aef93271ceb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946422.576521:0:8514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff914688aef200/0x16e41aef93271ceb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946422.576528:0:8514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff914688aef200/0x16e41aef93271ceb lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946423.025182:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946423.280658:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303308928:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790946423.280728:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946423.280779:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303308928 00000100:00100000:3.0:1790946423.280788:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303308928 00000100:00100000:3.0:1790946423.280863:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790946423.280874:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b6318380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303308928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790946423.280912:0:6678:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790946423.280972:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b6318380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303308928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946423.280980:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1790946423.281032:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146c1cfe300 x1877943303308928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790946439 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946423.281052:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303308928:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1790946423.281054:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790946423.978851:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946423.979024:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286503296 00000100:00100000:2.0:1790946423.979034:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286503296 00000100:00100000:2.0:1790946423.979080:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 173 00000100:00100000:2.0:1790946423.979088:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec4ece38-7293-498c-8428-4d215a1f0fd0+9:5602:x1877943286503296:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790946423.979104:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946423.979122:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff914688aeea00/0x16e41aef93271cf2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cbbe expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946423.979148:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff914688aeea00/0x16e41aef93271cf2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cbbe expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946423.979159:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff914688aeea00/0x16e41aef93271cf2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cbbe expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946423.979168:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914688aeea00, rc 0) 00000100:00100000:2.0:1790946423.979243:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec4ece38-7293-498c-8428-4d215a1f0fd0+10:5602:x1877943286503296:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 Request processed in 154us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946423.979260:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 173 00000100:00100000:3.0:1790946423.986595:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946423.986641:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286503424 00000100:00100000:3.0:1790946423.986651:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286503424 00000100:00100000:3.0:1790946423.986705:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 174 00000100:00100000:3.0:1790946423.986715:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+10:5602:x1877943286503424:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790946423.987008:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+10:5602:x1877943286503424:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 Request processed in 293us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946423.987016:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 174 00000100:00100000:2.0:1790946423.998760:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946423.998863:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286503552 00000100:00100000:2.0:1790946423.998875:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286503552 00000100:00100000:2.0:1790946423.998921:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 175 00000100:00100000:2.0:1790946423.998929:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec4ece38-7293-498c-8428-4d215a1f0fd0+10:5602:x1877943286503552:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790946423.999466:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec4ece38-7293-498c-8428-4d215a1f0fd0+10:5602:x1877943286503552:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 Request processed in 535us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946423.999475:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 175 00000100:00100000:0.0:1790946424.010069:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946424.010390:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286503680 00000100:00100000:3.0:1790946424.010400:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286503680 00000100:00100000:3.0:1790946424.010464:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 176 00000100:00100000:3.0:1790946424.010474:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec4ece38-7293-498c-8428-4d215a1f0fd0+10:6152:x1877943286503680:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790946424.010730:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec4ece38-7293-498c-8428-4d215a1f0fd0+10:6152:x1877943286503680:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 257us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946424.010737:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 176 00000100:00100000:2.0:1790946424.019824:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946424.019919:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286503808 00000100:00100000:0.0:1790946424.019930:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286503808 00000100:00100000:0.0:1790946424.020014:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 177 00000100:00100000:0.0:1790946424.020024:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+10:6152:x1877943286503808:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790946424.020529:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+10:6152:x1877943286503808:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 505us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946424.020537:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 177 00000100:00100000:2.0:1790946424.035718:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946424.035786:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946424.035815:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946424.035852:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286503936 00000100:00100000:1.0:1790946424.035862:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286503936 00000100:00100000:1.0:1790946424.035920:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 30 00000100:00100000:1.0:1790946424.035929:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2363:x1877943286503936:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790946424.036010:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2363:x1877943286503936:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 81us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946424.036016:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 30 00000100:00080000:1.0:1790946424.036038:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790946424.036707:0:6808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286504064 00000100:00100000:0.0:1790946424.036722:0:6808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286504064 00000100:00100000:0.0:1790946424.036763:0:6808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286504192 00000100:00100000:0.0:1790946424.036765:0:6808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286504192 00000100:00100000:0.0:1790946424.036785:0:6808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:0.0:1790946424.036792:0:6808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+5:2364:x1877943286504064:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1790946424.036831:0:6808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+5:2364:x1877943286504064:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 40us (1122us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946424.036838:0:6808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:0.0:1790946424.036850:0:6808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:0.0:1790946424.036856:0:6808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+5:2363:x1877943286504192:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1790946424.036874:0:6808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+5:2363:x1877943286504192:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 18us (1058us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946424.036879:0:6808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00080000:2.0:1790946424.036924:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790946424.036928:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790946424.048534:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1790946424.245113:0:5831:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790946424.245122:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9145853b6000 from 4 10000000:01000000:1.0:1790946424.245127:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790946424.245176:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146b180f000/0x16e41aef93271cf9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946424.245190:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9146b180f000/0x16e41aef93271cf9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946424.245231:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9146b180f000/0x16e41aef93271cf9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946424.245256:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b68aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303309056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790946424.245331:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946424.245377:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146863d3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790946424.245548:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303309056 00000100:00100000:2.0:1790946424.245556:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303309056 00000100:00100000:2.0:1790946424.245726:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1790946424.245735:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+16:5831:x1877943303309056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790946424.245749:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946424.245763:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff914688aeee00/0x16e41aef93271d00 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x16e41aef93271cf9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946424.245786:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff914688aeee00/0x16e41aef93271d00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x16e41aef93271cf9 expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946424.245811:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff914688aeee00/0x16e41aef93271d00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93271cf9 expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946424.245821:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914688aeee00, rc 0) 00000100:00100000:2.0:1790946424.245862:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+17:5831:x1877943303309056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946424.245869:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1790946424.246084:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b68aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303309056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790946424.246099:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9146b180f000/0x16e41aef93271cf9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271d00 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946424.246118:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9146b180f000/0x16e41aef93271cf9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93271d00 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946424.246166:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b68aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303309184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790946424.246191:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946424.246233:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146863d3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790946424.246245:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303309184 00000100:00100000:1.0:1790946424.246249:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303309184 00000100:00100000:1.0:1790946424.246431:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1790946424.246441:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+17:5831:x1877943303309184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790946424.246682:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+17:5831:x1877943303309184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 243us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946424.246689:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1790946424.246722:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b68aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303309184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790946424.246748:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b68aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303309312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790946424.246786:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946424.246799:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146863d3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790946424.246813:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303309312 00000100:00100000:1.0:1790946424.246816:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303309312 00000100:00100000:1.0:1790946424.246837:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1790946424.246843:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+17:5831:x1877943303309312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790946424.248078:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+17:5831:x1877943303309312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1229us (1286us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946424.248087:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1790946424.248160:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b68aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303309312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790946424.248475:0:8589:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b68aa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:8589:1877943303309440:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790946424.248514:0:8589:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946424.248539:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303309440 00000100:00100000:1.0:1790946424.248543:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303309440 00000100:00100000:1.0:1790946424.248571:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1790946424.248577:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+17:8589:x1877943303309440:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790946424.248733:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+17:8589:x1877943303309440:12345-0@lo:502:llog_process_th.0 Request processed in 155us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946424.248741:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1790946424.248771:0:8589:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146b6571b40 going to sleep for 11 seconds 00000100:00100000:1.0:1790946424.248783:0:8589:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b68aa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:8589:1877943303309440:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790946424.248802:0:8589:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790946424.248811:0:8589:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790946424.248813:0:8589:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1790946424.248820:0:8589:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9145853b6000 00000020:00000080:1.0:1790946424.248822:0:8589:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1790946424.253640:0:8589:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b68aa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:8589:1877943303309568:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790946424.253724:0:8589:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946424.253764:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303309568 00000100:00100000:1.0:1790946424.253771:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303309568 00000100:00100000:1.0:1790946424.253814:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1790946424.253822:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468494e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+17:8589:x1877943303309568:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790946424.254309:0:8589:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146b6571b40 going to sleep for 11 seconds 00000100:00100000:1.0:1790946424.255125:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468494e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+17:8589:x1877943303309568:12345-0@lo:502:llog_process_th.0 Request processed in 1300us (1399us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946424.255135:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1790946424.255906:0:8589:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b68aa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:8589:1877943303309568:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790946424.255941:0:8589:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790946424.255949:0:8589:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790946424.255951:0:8589:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1790946424.255957:0:8589:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1790946424.256057:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1790946424.256077:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790946424.256088:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146b180f000/0x16e41aef93271cf9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271d00 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946424.256187:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9146b180f000/0x16e41aef93271cf9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271d00 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790946424.256225:0:5831:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790946424.256229:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9146be38b800 from 4 10000000:01000000:2.0:1790946424.256232:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790946424.256263:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff914688aee600/0x16e41aef93271d07 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946424.256275:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff914688aee600/0x16e41aef93271d07 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946424.256283:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff914688aee600/0x16e41aef93271d07 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946424.256308:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cfed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303309696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790946424.256378:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946424.256414:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146879a9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1790946424.257598:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303309696 00000100:00100000:1.0:1790946424.257620:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303309696 00000100:00100000:1.0:1790946424.257666:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1790946424.257676:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468494c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+17:5831:x1877943303309696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790946424.257690:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946424.257707:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9146b180fc00/0x16e41aef93271d0e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x16e41aef93271d07 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946424.257731:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9146b180fc00/0x16e41aef93271d0e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x16e41aef93271d07 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946424.257741:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9146b180fc00/0x16e41aef93271d0e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93271d07 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946424.257749:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b180fc00, rc 0) 00000100:00100000:1.0:1790946424.257802:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468494c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+18:5831:x1877943303309696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (1427us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946424.257808:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1790946424.257851:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cfed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303309696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790946424.257866:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff914688aee600/0x16e41aef93271d07 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271d0e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946424.258022:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff914688aee600/0x16e41aef93271d07 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93271d0e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946424.258098:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b68aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303309824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790946424.258129:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946424.258146:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff914584b3c180 going to sleep for 11 seconds 00000100:00100000:1.0:1790946424.258164:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303309824 00000100:00100000:1.0:1790946424.258168:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303309824 00000100:00100000:1.0:1790946424.258189:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1790946424.258195:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468494c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+18:5831:x1877943303309824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790946424.261694:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468494c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+18:5831:x1877943303309824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3491us (3556us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946424.261707:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1790946424.261765:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b68aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303309824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790946424.261811:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b68aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303309952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790946424.261853:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946424.266100:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff914584b3c180 going to sleep for 11 seconds 00000100:00100000:1.0:1790946424.266128:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303309952 00000100:00100000:1.0:1790946424.266138:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303309952 00000100:00100000:1.0:1790946424.266181:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1790946424.266189:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468494e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+18:5831:x1877943303309952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790946424.266456:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468494e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+18:5831:x1877943303309952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 266us (4601us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946424.266464:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1790946424.266509:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b68aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303309952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790946424.267233:0:8592:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bdcc9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:8592:1877943303310080:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790946424.267276:0:8592:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946424.267303:0:8592:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146901490c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790946424.268418:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303310080 00000100:00100000:1.0:1790946424.268430:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303310080 00000100:00100000:1.0:1790946424.268477:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1790946424.268486:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468494e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+18:8592:x1877943303310080:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790946424.268740:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468494e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+18:8592:x1877943303310080:12345-0@lo:502:llog_process_th.0 Request processed in 255us (1461us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946424.268748:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1790946424.268992:0:8592:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bdcc9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:8592:1877943303310080:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790946424.269027:0:8592:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790946424.269037:0:8592:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790946424.269039:0:8592:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1790946424.269046:0:8592:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9146be38b800 00000020:00000080:3.0:1790946424.269055:0:8592:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1790946424.269275:0:8592:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bdcc9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:8592:1877943303310208:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790946424.269323:0:8592:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946424.269355:0:8592:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146901490c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790946424.269846:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303310208 00000100:00100000:1.0:1790946424.269860:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303310208 00000100:00100000:1.0:1790946424.270076:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1790946424.270084:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468494f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+18:8592:x1877943303310208:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790946424.270282:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468494f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+18:8592:x1877943303310208:12345-0@lo:502:llog_process_th.0 Request processed in 199us (958us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946424.270288:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1790946424.270970:0:8592:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bdcc9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:8592:1877943303310208:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790946424.271004:0:8592:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790946424.271012:0:8592:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790946424.271014:0:8592:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1790946424.271018:0:8592:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1790946424.271475:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1790946424.271495:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790946424.271505:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff914688aee600/0x16e41aef93271d07 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271d0e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946424.271516:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff914688aee600/0x16e41aef93271d07 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271d0e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790946424.271527:0:5831:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790946424.271529:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9146aa748800 from 4 10000000:01000000:1.0:1790946424.271532:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790946424.271561:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146b180fa00/0x16e41aef93271d15 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946424.271569:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9146b180fa00/0x16e41aef93271d15 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946424.271577:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9146b180fa00/0x16e41aef93271d15 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946424.271594:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b68aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303310336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790946424.271655:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946424.271685:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146855560c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790946424.271718:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303310336 00000100:00100000:2.0:1790946424.271725:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303310336 00000100:00100000:2.0:1790946424.271760:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1790946424.271768:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468494d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+18:5831:x1877943303310336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790946424.271781:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946424.271793:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff914688aef800/0x16e41aef93271d1c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x16e41aef93271d15 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946424.271817:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff914688aef800/0x16e41aef93271d1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x16e41aef93271d15 expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946424.271828:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff914688aef800/0x16e41aef93271d1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93271d15 expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946424.271837:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914688aef800, rc 0) 00000100:00100000:2.0:1790946424.271889:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468494d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:5831:x1877943303310336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946424.271896:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1790946424.272670:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b68aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303310336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790946424.272696:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9146b180fa00/0x16e41aef93271d15 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271d1c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946424.272706:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9146b180fa00/0x16e41aef93271d15 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93271d1c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946424.272762:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b68aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303310464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790946424.272802:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946424.272838:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146855560c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790946424.272959:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303310464 00000100:00100000:2.0:1790946424.272966:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303310464 00000100:00100000:2.0:1790946424.273004:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1790946424.273013:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468494dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:5831:x1877943303310464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790946424.273298:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468494dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:5831:x1877943303310464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 287us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946424.273306:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1790946424.273363:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b68aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303310464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790946424.273392:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b68aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303310592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790946424.273431:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946424.273455:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146855560c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790946424.273970:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303310592 00000100:00100000:2.0:1790946424.273983:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303310592 00000100:00100000:2.0:1790946424.274013:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1790946424.274021:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468494cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:5831:x1877943303310592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790946424.274360:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468494cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:5831:x1877943303310592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 339us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946424.274367:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1790946424.274997:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b68aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303310592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790946424.277532:0:8593:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b68aa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:8593:1877943303310720:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790946424.277628:0:8593:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946424.277672:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303310720 00000100:00100000:1.0:1790946424.277680:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303310720 00000100:00100000:1.0:1790946424.277727:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1790946424.277737:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468494c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:8593:x1877943303310720:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790946424.278005:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468494c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:8593:x1877943303310720:12345-0@lo:502:llog_process_th.0 Request processed in 269us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946424.278015:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1790946424.278073:0:8593:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146855560c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790946424.278097:0:8593:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b68aa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:8593:1877943303310720:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790946424.278135:0:8593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790946424.278145:0:8593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790946424.278147:0:8593:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1790946424.278155:0:8593:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9146aa748800 00000020:00000080:1.0:1790946424.278159:0:8593:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1790946424.278244:0:8593:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b68aa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:8593:1877943303310848:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790946424.278356:0:8593:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946424.278382:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303310848 00000100:00100000:1.0:1790946424.278386:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303310848 00000100:00100000:1.0:1790946424.278418:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1790946424.278426:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682e30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:8593:x1877943303310848:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790946424.278596:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682e30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:8593:x1877943303310848:12345-0@lo:502:llog_process_th.0 Request processed in 171us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946424.278603:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1790946424.278650:0:8593:0:(client.c:2716:ptlrpc_set_wait()) set ffff914684fa6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1790946424.278663:0:8593:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b68aa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:8593:1877943303310848:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790946424.278687:0:8593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790946424.278692:0:8593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790946424.278694:0:8593:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1790946424.278698:0:8593:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1790946424.279892:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1790946424.279919:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790946424.279930:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146b180fa00/0x16e41aef93271d15 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271d1c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946424.279942:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9146b180fa00/0x16e41aef93271d15 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271d1c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946425.072405:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946425.842622:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bdcc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303311360:0@lo:400:kworker.0 00000100:00100000:0.0:1790946425.842629:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bdcc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3303:1877943303310976:0@lo:400:kworker.0 00000100:00100000:2.0:1790946425.842684:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bdcc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877943303311104:0@lo:400:kworker.0 00000100:00100000:0.0:1790946425.842730:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946425.842732:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946425.842742:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946425.842790:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303311616:0@lo:400:kworker.0 00000100:00100000:2.0:1790946425.842822:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946425.842828:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303311104 00000100:00100000:0.0:1790946425.842829:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1877943303311488:0@lo:400:kworker.0 00000100:00100000:1.0:1790946425.842837:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303311104 00000100:00100000:2.0:1790946425.842852:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790946425.842861:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bdcca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1877943303311232:0@lo:400:kworker.0 00000100:00100000:0.0:1790946425.842869:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946425.842887:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303311488 00000100:00100000:1.0:1790946425.842891:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303311488 00000100:00100000:2.0:1790946425.842898:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946425.842927:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303311232 00000100:00100000:1.0:1790946425.842940:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303311232 00000100:00100000:0.0:1790946425.842940:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790946425.842941:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303311360 00000100:00100000:2.0:1790946425.842947:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303311360 00000100:00100000:0.0:1790946425.842963:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877943303311104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946425.842969:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790946425.842985:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303311616 00000100:00100000:2.0:1790946425.842990:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303311616 00000100:00100000:2.0:1790946425.843018:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790946425.843027:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b68aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303311360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946425.843042:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877943303311104:12345-0@lo:400:kworker.0 Request processed in 82us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946425.843049:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b6319880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877943303311488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946425.843055:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790946425.843073:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b68aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303311360:12345-0@lo:400:kworker.0 Request processed in 46us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946425.843080:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790946425.843084:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790946425.843095:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1877943303311232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946425.843109:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790946425.843110:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b6319880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877943303311488:12345-0@lo:400:kworker.0 Request processed in 63us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946425.843124:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790946425.843125:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303311616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946425.843138:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1877943303311232:12345-0@lo:400:kworker.0 Request processed in 46us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946425.843146:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1790946425.843151:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790946425.843158:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790946425.843162:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790946425.843171:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303311616:12345-0@lo:400:kworker.0 Request processed in 51us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946425.843189:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1790946425.843234:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146bdcc9c00 x1877943303311360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790946441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946425.843237:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1877943303311488:0@lo:400:kworker.0 00000100:00100000:1.0:1790946425.843253:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bdcc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303311360:0@lo:400:kworker.0 00000100:00100000:2.0:1790946425.843277:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bdcca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1877943303311232:0@lo:400:kworker.0 00000100:00100000:2.0:1790946425.843293:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bdcc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877943303311104:0@lo:400:kworker.0 00010000:00080000:2.0:1790946425.843305:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146c1cf9180 x1877943303311616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790946441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946425.843314:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303311616:0@lo:400:kworker.0 00000100:00100000:3.0:1790946425.848317:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303310976 00000100:00100000:3.0:1790946425.848334:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303310976 00000100:00100000:3.0:1790946425.848387:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1790946425.848397:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682e30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3303:x1877943303310976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946425.848497:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682e30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3303:x1877943303310976:12345-0@lo:400:kworker.0 Request processed in 102us (5772us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946425.848505:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1790946425.848541:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bdcc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3303:1877943303310976:0@lo:400:kworker.0 00010000:00010000:2.0:1790946426.096424:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946426.355412:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bdcc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303311744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790946426.355512:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946426.355629:0:6676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303311744 00000100:00100000:1.0:1790946426.355639:0:6676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303311744 00000100:00100000:1.0:1790946426.355698:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790946426.355709:0:6676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bdcc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1877943303311744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790946426.355756:0:6676:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790946426.355815:0:6676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bdcc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1877943303311744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946426.355831:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1790946426.355864:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146bdcc9880 x1877943303311744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790946442 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946426.355887:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bdcc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303311744:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790946427.126524:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946428.152798:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946428.401687:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790946428.401727:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bdcca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303311872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790946428.401835:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946428.401919:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303311872 00000100:00100000:1.0:1790946428.401928:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303311872 00000100:00100000:1.0:1790946428.401999:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790946428.402009:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bdcc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877943303311872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790946428.402054:0:6678:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790946428.402106:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bdcc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877943303311872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946428.402114:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1790946428.402138:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790946428.402176:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146bdcca680 x1877943303311872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790946444 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946428.402197:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bdcca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303311872:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1790946429.073038:0:8814:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:1.0:1790946429.165553:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946429.165611:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946429.165655:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946429.165776:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946429.165792:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286504448 00000100:00100000:1.0:1790946429.165805:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286504320 00000100:00100000:2.0:1790946429.165806:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286504448 00000100:00100000:1.0:1790946429.165808:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286504320 00000100:00100000:2.0:1790946429.165866:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 34 00000100:00100000:2.0:1790946429.165880:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bdcca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2363:x1877943286504448:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790946429.165938:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 194 00000100:00100000:1.0:1790946429.165947:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682e33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+10:2363:x1877943286504320:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790946429.165985:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682e33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+10:2363:x1877943286504320:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 39us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946429.165994:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 194 00000100:00100000:1.0:1790946429.166036:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286504704 00000100:00100000:1.0:1790946429.166045:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286504704 00000100:00100000:1.0:1790946429.166132:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286504576 00000100:00100000:1.0:1790946429.166136:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286504576 00000100:00100000:1.0:1790946429.166161:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:1.0:1790946429.166168:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bdcc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+5:2363:x1877943286504704:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1790946429.166193:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:0.0:1790946429.166233:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5eb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+5:2363:x1877943286504576:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790946429.166373:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bdcca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2363:x1877943286504448:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 497us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946429.166374:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bdcc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+5:2363:x1877943286504704:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 204us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946429.166382:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 34 00000100:00100000:1.0:1790946429.166383:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00080000:1.0:1790946429.166402:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790946429.166406:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790946429.166409:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790946429.166956:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5eb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+5:2363:x1877943286504576:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 751us (1177us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946429.166967:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 21 00010000:00010000:1.0:1790946429.168493:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946430.192384:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946430.961276:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b631a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877943303312128:0@lo:400:kworker.0 00000100:00100000:2.0:1790946430.961339:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b6318a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3303:1877943303312000:0@lo:400:kworker.0 00000100:00100000:0.0:1790946430.961397:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946430.961398:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946430.961459:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b631b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303312640:0@lo:400:kworker.0 00000100:00100000:3.0:1790946430.961484:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b6318e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303312384:0@lo:400:kworker.0 00000100:00100000:0.0:1790946430.961493:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946430.961539:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946430.961546:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790946430.961554:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b631b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1877943303312256:0@lo:400:kworker.0 00000100:00100000:0.0:1790946430.961605:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946430.961648:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303312128 00000100:00100000:0.0:1790946430.961657:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303312128 00000100:00100000:0.0:1790946430.961711:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303312256 00000100:00100000:0.0:1790946430.961715:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303312256 00000100:00100000:0.0:1790946430.961749:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790946430.961759:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b631ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877943303312128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946430.961817:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b631ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877943303312128:12345-0@lo:400:kworker.0 Request processed in 59us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946430.961824:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790946430.961845:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790946430.961850:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be074700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1877943303312256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946430.961881:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be074700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1877943303312256:12345-0@lo:400:kworker.0 Request processed in 30us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946430.961887:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790946430.961912:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303312640 00000100:00100000:0.0:1790946430.961916:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303312640 00000100:00100000:3.0:1790946430.961948:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303312384 00000100:00100000:3.0:1790946430.961954:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303312384 00000100:00100000:0.0:1790946430.961958:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790946430.961967:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b631aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303312640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946430.961999:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790946430.962004:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b631aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303312640:12345-0@lo:400:kworker.0 Request processed in 36us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946430.962013:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303312384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946430.962013:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1790946430.962053:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790946430.962060:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790946430.962065:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303312384:12345-0@lo:400:kworker.0 Request processed in 54us (524us total) trans 0 rc 0/0 00000100:00080000:0.0:1790946430.962066:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790946430.962077:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790946430.962115:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b631b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1877943303312256:0@lo:400:kworker.0 00000100:00100000:0.0:1790946430.962137:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b631a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877943303312128:0@lo:400:kworker.0 00010000:00080000:0.0:1790946430.962149:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146b631b100 x1877943303312640/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790946446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946430.962160:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b631b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303312640:0@lo:400:kworker.0 00010000:00080000:3.0:1790946430.962801:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146b6318e00 x1877943303312384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790946446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946430.962830:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b6318e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303312384:0@lo:400:kworker.0 00000100:00100000:3.0:1790946430.962875:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303312000 00000100:00100000:3.0:1790946430.962882:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303312000 00000100:00100000:3.0:1790946430.962916:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1790946430.962923:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682e33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3303:x1877943303312000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946430.962973:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682e33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3303:x1877943303312000:12345-0@lo:400:kworker.0 Request processed in 50us (1580us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946430.962980:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1790946430.967165:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b6318a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3303:1877943303312000:0@lo:400:kworker.0 00000100:00100000:3.0:1790946430.967185:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b6319500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1877943303312512:0@lo:400:kworker.0 00000100:00100000:3.0:1790946430.967296:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946430.967417:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303312512 00000100:00100000:0.0:1790946430.967427:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303312512 00000100:00100000:0.0:1790946430.967517:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790946430.967528:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877943303312512:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1790946430.967606:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790946430.967618:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877943303312512:12345-0@lo:400:kworker.0 Request processed in 91us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946430.967628:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790946430.967669:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b6319500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1877943303312512:0@lo:400:kworker.0 00010000:00010000:1.0:1790946431.216370:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946431.473458:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790946431.473489:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5eb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303312768:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790946431.473608:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946431.473704:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303312768 00000100:00100000:1.0:1790946431.473715:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303312768 00000100:00100000:1.0:1790946431.473796:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790946431.473807:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5eb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303312768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790946431.473856:0:6678:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790946431.473914:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5eb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303312768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946431.473922:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1790946431.473973:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146b5eb3480 x1877943303312768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790946447 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946431.473994:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5eb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303312768:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790946432.244266:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946433.272613:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946433.522335:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303312896:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790946433.522604:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946433.522991:0:6676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303312896 00000100:00100000:3.0:1790946433.523004:0:6676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303312896 00000100:00100000:3.0:1790946433.523084:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790946433.523098:0:6676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303312896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790946433.523154:0:6676:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1790946433.523256:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790946433.525137:0:6676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303312896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2030us (2522us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946433.525154:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1790946433.525535:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146c1cfd500 x1877943303312896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790946449 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946433.525579:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303312896:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790946434.275188:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946434.275278:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946434.275496:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286504832 00000100:00100000:0.0:1790946434.275510:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286504832 00000100:00100000:0.0:1790946434.275585:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 196 00000100:00100000:0.0:1790946434.275596:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682e33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec4ece38-7293-498c-8428-4d215a1f0fd0+10:2364:x1877943286504832:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1790946434.275699:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682e33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec4ece38-7293-498c-8428-4d215a1f0fd0+10:2364:x1877943286504832:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 104us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946434.275707:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 196 00000100:00100000:2.0:1790946434.275804:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286504960 00000100:00100000:2.0:1790946434.275810:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286504960 00000100:00100000:2.0:1790946434.275871:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 38 00000100:00100000:2.0:1790946434.275891:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2364:x1877943286504960:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790946434.275931:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2364:x1877943286504960:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 42us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946434.275937:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 38 00000100:00080000:0.0:1790946434.276501:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790946434.277241:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946434.277303:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286505088 00000100:00100000:0.0:1790946434.277314:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286505088 00000100:00100000:0.0:1790946434.277399:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:0.0:1790946434.277409:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+5:2360:x1877943286505088:12345-192.168.203.13@tcp:9:kworker.0 00000020:00000080:0.0:1790946434.277456:0:6675:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x16e41aef93271c58 00000100:00080000:0.0:1790946434.277470:0:6675:0:(import.c:65:import_set_state_nolock()) ffff9146bed8d000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790946434.277519:0:6675:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1790946434.277982:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+2:2360:x1877943286505088:12345-192.168.203.13@tcp:9:kworker.0 Request processed in 572us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946434.278000:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:3.0:1790946434.278064:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00010000:00010000:0.0:1790946434.278072:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946434.278099:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286505216 00000100:00100000:3.0:1790946434.278105:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286505216 00000100:00100000:3.0:1790946434.278144:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:3.0:1790946434.278171:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+5:2360:x1877943286505216:12345-192.168.203.13@tcp:9:kworker.0 00000020:00000080:3.0:1790946434.278224:0:6673:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x16e41aef93271c5f 00000100:00080000:3.0:1790946434.278236:0:6673:0:(import.c:65:import_set_state_nolock()) ffff914586f25800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790946434.278270:0:6673:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1790946434.278543:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+2:2360:x1877943286505216:12345-192.168.203.13@tcp:9:kworker.0 Request processed in 354us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946434.278551:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 11 00010000:00010000:3.0:1790946434.278602:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790946434.278679:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790946434.278685:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790946434.291325:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790946434.381395:0:9058:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing yml_node 00010000:00010000:1.0:1790946435.318468:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946436.080689:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5eb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303313408:0@lo:400:kworker.0 00000100:00100000:2.0:1790946436.080769:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946436.080835:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1790946436.080842:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5eb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3302:1877943303313024:0@lo:400:kworker.0 00000100:00100000:2.0:1790946436.080874:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946436.080895:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5eb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1877943303313536:0@lo:400:kworker.0 00000100:00100000:2.0:1790946436.080918:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946436.080966:0:6808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303313408 00000100:00100000:2.0:1790946436.080974:0:6808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303313408 00000100:00100000:2.0:1790946436.081033:0:6808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790946436.081044:0:6808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303313408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946436.081098:0:6808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303313408:12345-0@lo:400:kworker.0 Request processed in 57us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946436.081106:0:6808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1790946436.081127:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790946436.081154:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146b5eb3800 x1877943303313408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790946452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946436.081167:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5eb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303313408:0@lo:400:kworker.0 00000100:00100000:3.0:1790946436.081702:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5eb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877943303313152:0@lo:400:kworker.0 00000100:00100000:3.0:1790946436.081739:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946436.081770:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5eb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303313664:0@lo:400:kworker.0 00000100:00100000:3.0:1790946436.081794:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946436.081816:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790946436.081822:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5eb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1877943303313280:0@lo:400:kworker.0 00000100:00100000:3.0:1790946436.081844:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946436.081869:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303313664 00000100:00100000:3.0:1790946436.081874:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303313664 00000100:00100000:3.0:1790946436.081908:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790946436.081915:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303313664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946436.081969:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303313664:12345-0@lo:400:kworker.0 Request processed in 54us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946436.081976:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1790946436.082010:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146b5eb2d80 x1877943303313664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790946452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946436.082020:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5eb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303313664:0@lo:400:kworker.0 00000100:00100000:0.0:1790946436.082336:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303313024 00000100:00100000:0.0:1790946436.082342:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303313024 00000100:00100000:0.0:1790946436.082382:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1790946436.082390:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682e32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3302:x1877943303313024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946436.082434:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682e32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3302:x1877943303313024:12345-0@lo:400:kworker.0 Request processed in 46us (1559us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946436.082440:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1790946436.082467:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303313536 00000100:00100000:0.0:1790946436.082471:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303313536 00000100:00100000:0.0:1790946436.082497:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303313152 00000100:00100000:0.0:1790946436.082500:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303313152 00000100:00100000:0.0:1790946436.082512:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303313280 00000100:00100000:0.0:1790946436.082514:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303313280 00000100:00100000:0.0:1790946436.082539:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790946436.082546:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877943303313536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946436.082578:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877943303313536:12345-0@lo:400:kworker.0 Request processed in 33us (1658us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946436.082592:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790946436.082675:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790946436.082682:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877943303313152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946436.082722:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877943303313152:12345-0@lo:400:kworker.0 Request processed in 40us (981us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946436.082729:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790946436.082741:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790946436.082747:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1877943303313280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946436.082776:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1877943303313280:12345-0@lo:400:kworker.0 Request processed in 29us (930us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946436.082781:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790946436.082817:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5eb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1877943303313280:0@lo:400:kworker.0 00000100:00100000:0.0:1790946436.082827:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5eb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877943303313152:0@lo:400:kworker.0 00000100:00100000:0.0:1790946436.082855:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5eb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3302:1877943303313024:0@lo:400:kworker.0 00000100:00100000:0.0:1790946436.082865:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5eb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1877943303313536:0@lo:400:kworker.0 00000100:00080000:2.0:1790946436.083051:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790946436.083062:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1790946436.336987:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946436.592851:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5eb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303313792:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790946436.592934:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946436.593226:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303313792 00000100:00100000:1.0:1790946436.593235:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303313792 00000100:00100000:1.0:1790946436.593287:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790946436.593297:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be077100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1877943303313792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790946436.593332:0:6678:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790946436.593387:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be077100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1877943303313792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946436.593395:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1790946436.593630:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146b5eb1180 x1877943303313792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790946452 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946436.593648:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5eb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303313792:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790946437.362002:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1790946437.675023:0:6700:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7eed1f4b-bd5b-4a70-8045-59db065b3dfc 00000020:00000080:3.0:1790946437.675031:0:6700:0:(genops.c:885:class_export_put()) final put ffff9146bed8a000/7eed1f4b-bd5b-4a70-8045-59db065b3dfc 00000020:00000080:3.0:1790946437.675055:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9146bed8a000/7eed1f4b-bd5b-4a70-8045-59db065b3dfc for lustre-OST0000 00000020:00000080:3.0:1790946437.675090:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9146bed8d000 for lustre-OST0000 00000001:00100000:2.0:1790946437.702756:0:7645:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7eed1f4b-bd5b-4a70-8045-59db065b3dfc 00000020:00000080:2.0:1790946437.702767:0:7645:0:(genops.c:885:class_export_put()) final put ffff914586f26000/7eed1f4b-bd5b-4a70-8045-59db065b3dfc 00000020:00000080:2.0:1790946437.702796:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff914586f26000/7eed1f4b-bd5b-4a70-8045-59db065b3dfc for lustre-OST0001 00000020:00000080:2.0:1790946437.702839:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff914586f25800 for lustre-OST0001 00000001:02000400:1.0:1790946437.709443:0:9252:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.59.3 00010000:00010000:2.0:1790946438.386447:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946438.643452:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790946438.643474:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303313920:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790946438.643560:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946438.643625:0:6676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303313920 00000100:00100000:2.0:1790946438.643632:0:6676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303313920 00000100:00100000:2.0:1790946438.643697:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790946438.643707:0:6676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877943303313920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790946438.643741:0:6676:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790946438.643787:0:6676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877943303313920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946438.643795:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1790946438.643816:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790946438.643854:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146bee39c00 x1877943303313920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790946454 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946438.643874:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303313920:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790946439.394991:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946439.395044:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946439.395151:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286505344 00000100:00100000:0.0:1790946439.395184:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286505344 00000100:00100000:0.0:1790946439.395263:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 198 00000100:00100000:0.0:1790946439.395274:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec4ece38-7293-498c-8428-4d215a1f0fd0+10:2362:x1877943286505344:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1790946439.395351:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec4ece38-7293-498c-8428-4d215a1f0fd0+10:2362:x1877943286505344:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 79us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946439.395360:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 198 00000100:00100000:1.0:1790946439.395518:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286505472 00000100:00100000:1.0:1790946439.395524:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286505472 00000100:00100000:1.0:1790946439.395576:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 42 00000100:00100000:1.0:1790946439.395585:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2362:x1877943286505472:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790946439.395619:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2362:x1877943286505472:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 37us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946439.395626:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 42 00000100:00080000:0.0:1790946439.395794:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790946439.408384:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946440.433167:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790946440.470030:0:9349:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.59.3 00000100:00100000:3.0:1790946441.204787:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877943303314176:0@lo:400:kworker.0 00000100:00100000:3.0:1790946441.204864:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946441.204909:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303314688:0@lo:400:kworker.0 00000100:00100000:3.0:1790946441.204932:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946441.204958:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790946441.204964:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1877943303314304:0@lo:400:kworker.0 00000100:00100000:3.0:1790946441.204984:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946441.205578:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3303:1877943303314048:0@lo:400:kworker.0 00000100:00100000:2.0:1790946441.205623:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946441.205653:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1877943303314560:0@lo:400:kworker.0 00000100:00100000:2.0:1790946441.205674:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946441.205713:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790946441.205719:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303314432:0@lo:400:kworker.0 00000100:00100000:2.0:1790946441.205741:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946441.205770:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303314176 00000100:00100000:2.0:1790946441.205777:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303314176 00000100:00100000:2.0:1790946441.205821:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303314304 00000100:00100000:2.0:1790946441.205824:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303314304 00000100:00100000:2.0:1790946441.205845:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303314560 00000100:00100000:2.0:1790946441.205847:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303314560 00000100:00100000:2.0:1790946441.205862:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790946441.205870:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877943303314176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946441.205923:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877943303314176:12345-0@lo:400:kworker.0 Request processed in 53us (1059us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946441.205930:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790946441.205945:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790946441.205952:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1877943303314304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946441.205975:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1877943303314304:12345-0@lo:400:kworker.0 Request processed in 25us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946441.205981:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790946441.205989:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790946441.205994:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877943303314560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946441.206018:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877943303314560:12345-0@lo:400:kworker.0 Request processed in 23us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946441.206023:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790946441.206038:0:6808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303314688 00000100:00100000:2.0:1790946441.206040:0:6808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303314688 00000100:00100000:2.0:1790946441.206061:0:6808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303314432 00000100:00100000:2.0:1790946441.206063:0:6808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303314432 00000100:00100000:2.0:1790946441.206089:0:6808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790946441.206095:0:6808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303314688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946441.206123:0:6808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303314688:12345-0@lo:400:kworker.0 Request processed in 29us (1190us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946441.206129:0:6808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790946441.206138:0:6808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790946441.206159:0:6808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1877943303314432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946441.206184:0:6808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1877943303314432:12345-0@lo:400:kworker.0 Request processed in 27us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946441.206189:0:6808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1790946441.206444:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790946441.206449:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790946441.206451:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1790946441.206497:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146c1cf9500 x1877943303314432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790946457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946441.206510:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303314432:0@lo:400:kworker.0 00000100:00100000:2.0:1790946441.206522:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1877943303314560:0@lo:400:kworker.0 00000100:00100000:2.0:1790946441.206550:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1877943303314304:0@lo:400:kworker.0 00000100:00100000:2.0:1790946441.206561:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877943303314176:0@lo:400:kworker.0 00010000:00080000:2.0:1790946441.206570:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146c1cf8a80 x1877943303314688/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790946457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946441.206577:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303314688:0@lo:400:kworker.0 00000100:00100000:3.0:1790946441.206658:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303314048 00000100:00100000:3.0:1790946441.206662:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303314048 00000100:00100000:3.0:1790946441.206688:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1790946441.206694:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3303:x1877943303314048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946441.206739:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3303:x1877943303314048:12345-0@lo:400:kworker.0 Request processed in 45us (1115us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946441.206744:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1790946441.206893:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3303:1877943303314048:0@lo:400:kworker.0 00010000:00010000:0.0:1790946441.458720:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946441.717973:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303314816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790946441.718082:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946441.718185:0:6676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303314816 00000100:00100000:2.0:1790946441.718194:0:6676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303314816 00000100:00100000:2.0:1790946441.718272:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790946441.718283:0:6676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1877943303314816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790946441.718332:0:6676:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790946441.718389:0:6676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1877943303314816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946441.718397:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1790946441.718449:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146bee3aa00 x1877943303314816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790946457 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946441.718471:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303314816:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790946442.483834:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790946443.105318:0:9447:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.59.3 00010000:00010000:0.0:1790946443.507550:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946443.763052:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303314944:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790946443.763161:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946443.763312:0:6676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303314944 00000100:00100000:3.0:1790946443.763324:0:6676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303314944 00000100:00100000:3.0:1790946443.763404:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790946443.763447:0:6676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303314944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790946443.763504:0:6676:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790946443.763560:0:6676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303314944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946443.763568:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1790946443.763595:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790946443.763633:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146bee3aa00 x1877943303314944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790946459 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946443.763654:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303314944:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790946444.516268:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946444.516317:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946444.516466:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286505600 00000100:00100000:2.0:1790946444.516482:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286505600 00000100:00100000:2.0:1790946444.516553:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 200 00000100:00100000:2.0:1790946444.516566:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+10:2362:x1877943286505600:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790946444.516661:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+10:2362:x1877943286505600:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 97us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946444.516669:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 200 00000100:00100000:1.0:1790946444.516761:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286505728 00000100:00100000:1.0:1790946444.516767:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286505728 00000100:00100000:1.0:1790946444.516827:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 46 00000100:00100000:1.0:1790946444.516835:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2362:x1877943286505728:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790946444.516872:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2362:x1877943286505728:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 39us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946444.516896:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 46 00000100:00080000:2.0:1790946444.516950:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1790946444.528559:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790946444.856079:0:9495:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Oct 2 09:07:22 EDT 2026 00010000:00010000:2.0:1790946445.552436:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946446.325230:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303315456:0@lo:400:kworker.0 00000100:00100000:3.0:1790946446.325325:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946446.325403:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1790946446.325409:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3302:1877943303315072:0@lo:400:kworker.0 00000100:00100000:3.0:1790946446.325442:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946446.325482:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1877943303315584:0@lo:400:kworker.0 00000100:00100000:3.0:1790946446.325510:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946446.325537:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1877943303315328:0@lo:400:kworker.0 00000100:00100000:3.0:1790946446.325560:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946446.325580:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1790946446.325585:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1877943303315200:0@lo:400:kworker.0 00000100:00100000:3.0:1790946446.325607:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946446.325750:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303315072 00000100:00100000:1.0:1790946446.325761:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303315072 00000100:00100000:1.0:1790946446.325822:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1790946446.325832:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3302:x1877943303315072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946446.325899:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3302:x1877943303315072:12345-0@lo:400:kworker.0 Request processed in 68us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946446.325907:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1790946446.325950:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303315584 00000100:00100000:1.0:1790946446.325954:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303315584 00000100:00100000:1.0:1790946446.325993:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303315328 00000100:00100000:1.0:1790946446.325997:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303315328 00000100:00100000:1.0:1790946446.326011:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303315200 00000100:00100000:1.0:1790946446.326014:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303315200 00000100:00100000:1.0:1790946446.326026:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790946446.326032:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5fdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877943303315584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946446.326070:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5fdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877943303315584:12345-0@lo:400:kworker.0 Request processed in 37us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946446.326077:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790946446.326089:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790946446.326095:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5fdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1877943303315328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946446.326124:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5fdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1877943303315328:12345-0@lo:400:kworker.0 Request processed in 30us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946446.326130:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790946446.326142:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790946446.326147:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5fdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1877943303315200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946446.326197:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5fdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1877943303315200:12345-0@lo:400:kworker.0 Request processed in 49us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946446.326236:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790946446.326287:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3302:1877943303315072:0@lo:400:kworker.0 00000100:00100000:1.0:1790946446.326304:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1877943303315584:0@lo:400:kworker.0 00000100:00080000:1.0:1790946446.326334:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790946446.326399:0:6808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303315456 00000100:00100000:1.0:1790946446.326404:0:6808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303315456 00000100:00100000:1.0:1790946446.326455:0:6808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790946446.326463:0:6808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5fdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303315456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946446.326502:0:6808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5fdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303315456:12345-0@lo:400:kworker.0 Request processed in 40us (1177us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946446.326508:0:6808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1790946446.326527:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790946446.326548:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146c1cf9f80 x1877943303315456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790946462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946446.326560:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303315456:0@lo:400:kworker.0 00000100:00100000:3.0:1790946446.327053:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1877943303315200:0@lo:400:kworker.0 00000100:00100000:3.0:1790946446.327075:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5fdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303315712:0@lo:400:kworker.0 00000100:00100000:3.0:1790946446.327120:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946446.327191:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1877943303315328:0@lo:400:kworker.0 00000100:00100000:2.0:1790946446.337136:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303315712 00000100:00100000:2.0:1790946446.337154:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303315712 00000100:00100000:2.0:1790946446.337572:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790946446.337592:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5fdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1877943303315712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946446.337721:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5fdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1877943303315712:12345-0@lo:400:kworker.0 Request processed in 132us (10600us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946446.337728:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1790946446.337784:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146b5fdc700 x1877943303315712/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790946462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946446.337802:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5fdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303315712:0@lo:400:kworker.0 00000100:00080000:0.0:1790946446.342533:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1790946446.576962:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946446.834260:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790946446.834286:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5eb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303315840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790946446.834359:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946446.834743:0:6676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303315840 00000100:00100000:3.0:1790946446.834751:0:6676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303315840 00000100:00100000:3.0:1790946446.834808:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790946446.834819:0:6676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5eb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303315840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790946446.834858:0:6676:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790946446.834913:0:6676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5eb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303315840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946446.834921:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1790946446.834966:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146b5eb0e00 x1877943303315840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790946462 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946446.834985:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5eb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303315840:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790946447.600476:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946448.624413:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946448.880914:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303315968:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790946448.881024:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946448.881194:0:6676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303315968 00000100:00100000:2.0:1790946448.881232:0:6676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303315968 00000100:00100000:2.0:1790946448.881312:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790946448.881326:0:6676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5fddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303315968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790946448.881376:0:6676:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1790946448.881423:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790946448.891742:0:6676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5fddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303315968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 10407us (10704us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946448.891762:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1790946448.894508:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146bee3b480 x1877943303315968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790946464 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946448.894546:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303315968:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790946449.631048:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946449.632234:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946449.632509:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286505856 00000100:00100000:2.0:1790946449.632520:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286505856 00000100:00100000:2.0:1790946449.632575:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 202 00000100:00100000:2.0:1790946449.632585:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec4ece38-7293-498c-8428-4d215a1f0fd0+10:2361:x1877943286505856:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790946449.632664:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec4ece38-7293-498c-8428-4d215a1f0fd0+10:2361:x1877943286505856:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 80us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946449.632671:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 202 00000100:00100000:1.0:1790946449.634345:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286505984 00000100:00100000:1.0:1790946449.634357:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286505984 00000100:00100000:1.0:1790946449.634545:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 50 00000100:00100000:1.0:1790946449.634554:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5fdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2361:x1877943286505984:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790946449.634618:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5fdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2361:x1877943286505984:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 66us (3579us total) trans 0 rc 0/0 00000100:00080000:2.0:1790946449.634720:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790946449.634902:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 50 00010000:00010000:2.0:1790946449.651171:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946450.680879:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946451.442346:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be074000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877943303316224:0@lo:400:kworker.0 00000100:00100000:0.0:1790946451.442453:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946451.442521:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be074a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303316736:0@lo:400:kworker.0 00000100:00100000:0.0:1790946451.442552:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946451.442591:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790946451.442597:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be077480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1877943303316352:0@lo:400:kworker.0 00000100:00100000:0.0:1790946451.442621:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946451.442661:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303316224 00000100:00100000:0.0:1790946451.442671:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303316224 00000100:00100000:0.0:1790946451.442724:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303316352 00000100:00100000:0.0:1790946451.442727:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303316352 00000100:00100000:0.0:1790946451.442766:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1790946451.442775:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be077800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877943303316224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946451.442840:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be077800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877943303316224:12345-0@lo:400:kworker.0 Request processed in 65us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946451.442864:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1790946451.442886:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790946451.442892:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be076d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1877943303316352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946451.442925:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be076d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1877943303316352:12345-0@lo:400:kworker.0 Request processed in 33us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946451.442931:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790946451.442955:0:6808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303316736 00000100:00100000:0.0:1790946451.442960:0:6808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303316736 00000100:00100000:0.0:1790946451.442992:0:6808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790946451.442999:0:6808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be076680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303316736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946451.443032:0:6808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be076680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303316736:12345-0@lo:400:kworker.0 Request processed in 33us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946451.443038:0:6808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1790946451.443064:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790946451.443069:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790946451.443129:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be077480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1877943303316352:0@lo:400:kworker.0 00000100:00100000:0.0:1790946451.443141:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be074000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877943303316224:0@lo:400:kworker.0 00010000:00080000:0.0:1790946451.443154:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146be074a80 x1877943303316736/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790946467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946451.443165:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be074a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303316736:0@lo:400:kworker.0 00000100:00100000:2.0:1790946451.443290:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be074380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3303:1877943303316096:0@lo:400:kworker.0 00000100:00100000:2.0:1790946451.443336:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946451.443375:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be075f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1877943303316608:0@lo:400:kworker.0 00000100:00100000:2.0:1790946451.443401:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946451.443433:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790946451.443441:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be075500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303316480:0@lo:400:kworker.0 00000100:00100000:2.0:1790946451.443465:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946451.443493:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303316480 00000100:00100000:2.0:1790946451.443497:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303316480 00000100:00100000:2.0:1790946451.443534:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790946451.443541:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1877943303316480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946451.443581:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1877943303316480:12345-0@lo:400:kworker.0 Request processed in 40us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946451.443587:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1790946451.443621:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146be075500 x1877943303316480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790946467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946451.443630:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be075500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303316480:0@lo:400:kworker.0 00000100:00100000:0.0:1790946451.443904:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303316096 00000100:00100000:0.0:1790946451.443909:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303316096 00000100:00100000:0.0:1790946451.443989:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1790946451.443997:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3303:x1877943303316096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946451.444058:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3303:x1877943303316096:12345-0@lo:400:kworker.0 Request processed in 62us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946451.444064:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00080000:1.0:1790946451.445110:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790946451.445136:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303316608 00000100:00100000:1.0:1790946451.445147:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303316608 00000100:00100000:1.0:1790946451.445224:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1790946451.445233:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877943303316608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946451.445309:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877943303316608:12345-0@lo:400:kworker.0 Request processed in 77us (1907us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946451.445315:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1790946451.445350:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790946451.445821:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be074380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3303:1877943303316096:0@lo:400:kworker.0 00000100:00100000:2.0:1790946451.445839:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be075f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1877943303316608:0@lo:400:kworker.0 00010000:00010000:3.0:1790946451.696518:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946451.952450:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5fdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303316864:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790946451.952525:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946451.952626:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303316864 00000100:00100000:3.0:1790946451.952634:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303316864 00000100:00100000:3.0:1790946451.952700:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790946451.952709:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be074a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1877943303316864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790946451.952742:0:6678:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790946451.952788:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be074a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1877943303316864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946451.952796:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1790946451.952930:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146b5fdf800 x1877943303316864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790946467 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946451.952950:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5fdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303316864:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790946452.722549:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946453.744846:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946454.001309:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790946454.001333:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146befb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303316992:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790946454.001416:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946454.002693:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303316992 00000100:00100000:3.0:1790946454.002706:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303316992 00000100:00100000:3.0:1790946454.002799:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790946454.002812:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146befb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877943303316992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790946454.002852:0:6678:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790946454.002926:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146befb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877943303316992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (1510us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946454.002932:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1790946454.003006:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146befb1c00 x1877943303316992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790946470 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946454.003191:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146befb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303316992:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1790946454.004538:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790946454.755578:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946454.755617:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946454.755647:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286506240 00000100:00100000:3.0:1790946454.755656:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286506240 00000100:00100000:3.0:1790946454.755714:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 54 00000100:00100000:3.0:1790946454.755724:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5fde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2364:x1877943286506240:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790946454.755803:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5fde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2364:x1877943286506240:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 80us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946454.755811:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 54 00000100:00080000:3.0:1790946454.755832:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790946454.756428:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286506112 00000100:00100000:1.0:1790946454.756434:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286506112 00000100:00100000:1.0:1790946454.756474:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 204 00000100:00100000:1.0:1790946454.756480:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec4ece38-7293-498c-8428-4d215a1f0fd0+10:2364:x1877943286506112:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790946454.756520:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec4ece38-7293-498c-8428-4d215a1f0fd0+10:2364:x1877943286506112:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 40us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946454.756526:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 204 00010000:00010000:3.0:1790946454.768340:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946455.792428:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946456.565602:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5fded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3303:1877943303317120:0@lo:400:kworker.0 00000100:00100000:0.0:1790946456.565705:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946456.565786:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790946456.565796:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5fde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303317504:0@lo:400:kworker.0 00000100:00100000:0.0:1790946456.565835:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946456.565861:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5fdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1877943303317376:0@lo:400:kworker.0 00000100:00100000:0.0:1790946456.565868:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5fdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1877943303317632:0@lo:400:kworker.0 00000100:00100000:1.0:1790946456.566173:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303317120 00000100:00100000:1.0:1790946456.566191:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303317120 00000100:00100000:2.0:1790946456.566420:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877943303317248:0@lo:400:kworker.0 00000100:00100000:1.0:1790946456.567419:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1790946456.567438:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3303:x1877943303317120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946456.568841:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946456.568958:0:6808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303317504 00000100:00100000:0.0:1790946456.568970:0:6808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303317504 00000100:00100000:0.0:1790946456.569057:0:6808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790946456.569068:0:6808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be074000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1877943303317504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946456.569139:0:6808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be074000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1877943303317504:12345-0@lo:400:kworker.0 Request processed in 73us (3302us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946456.569164:0:6808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1790946456.569241:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146b5fde300 x1877943303317504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790946472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946456.569257:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5fde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303317504:0@lo:400:kworker.0 00000100:00100000:0.0:1790946456.572145:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303317632 00000100:00100000:0.0:1790946456.572168:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303317632 00000100:00100000:0.0:1790946456.572299:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1790946456.572314:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be077480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877943303317632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946456.572572:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be077480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877943303317632:12345-0@lo:400:kworker.0 Request processed in 262us (3739us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946456.572581:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1790946456.572641:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5fdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1877943303317632:0@lo:400:kworker.0 00000100:00080000:3.0:1790946456.576989:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790946456.577002:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790946456.577067:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946456.580264:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946456.581733:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3303:x1877943303317120:12345-0@lo:400:kworker.0 Request processed in 14292us (16017us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946456.581750:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1790946456.581846:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5fded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3303:1877943303317120:0@lo:400:kworker.0 00000100:00100000:0.0:1790946456.593168:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303317376 00000100:00100000:0.0:1790946456.593182:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303317376 00000100:00100000:3.0:1790946456.593579:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303317248 00000100:00100000:3.0:1790946456.593599:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303317248 00000100:00100000:3.0:1790946456.593821:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790946456.593836:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5fdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1877943303317376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946456.594073:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5fdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1877943303317376:12345-0@lo:400:kworker.0 Request processed in 240us (17006us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946456.594101:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790946456.594126:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790946456.594132:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146befb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877943303317248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946456.594172:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146befb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877943303317248:12345-0@lo:400:kworker.0 Request processed in 40us (13919us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946456.594177:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790946456.594464:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877943303317248:0@lo:400:kworker.0 00000100:00100000:2.0:1790946456.594480:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5fdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303317760:0@lo:400:kworker.0 00000100:00100000:3.0:1790946456.594647:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5fdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1877943303317376:0@lo:400:kworker.0 00000100:00080000:1.0:1790946456.594731:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790946456.594859:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946456.595105:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303317760 00000100:00100000:3.0:1790946456.595113:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303317760 00000100:00080000:1.0:1790946456.595196:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790946456.596150:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790946456.596175:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146befb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303317760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946456.596321:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146befb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303317760:12345-0@lo:400:kworker.0 Request processed in 159us (1463us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946456.596328:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1790946456.596392:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146b5fdd880 x1877943303317760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790946472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946456.596408:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5fdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303317760:0@lo:400:kworker.0 00010000:00010000:3.0:1790946456.819387:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946457.073585:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be075180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303317888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790946457.073689:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946457.073801:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303317888 00000100:00100000:2.0:1790946457.073813:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303317888 00000100:00100000:2.0:1790946457.073878:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790946457.073889:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1877943303317888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790946457.073951:0:6678:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790946457.075840:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1877943303317888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1941us (2138us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946457.075855:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1790946457.076360:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146be075180 x1877943303317888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790946473 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946457.076401:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be075180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303317888:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790946457.840451:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946458.865047:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946459.120845:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5eb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303318016:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790946459.120923:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946459.120960:0:6676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303318016 00000100:00100000:2.0:1790946459.120970:0:6676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303318016 00000100:00080000:1.0:1790946459.120999:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790946459.121045:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790946459.121056:0:6676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303318016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790946459.121102:0:6676:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790946459.121160:0:6676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303318016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946459.121168:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1790946459.121386:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146b5eb1880 x1877943303318016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790946475 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946459.121407:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5eb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303318016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790946459.873487:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946459.873533:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946459.873724:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286506496 00000100:00100000:3.0:1790946459.873734:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286506496 00000100:00100000:3.0:1790946459.873806:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 58 00000100:00100000:3.0:1790946459.873816:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be074e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2363:x1877943286506496:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790946459.873901:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be074e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2363:x1877943286506496:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 86us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946459.873909:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 58 00000100:00100000:3.0:1790946459.873932:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286506368 00000100:00100000:3.0:1790946459.873936:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286506368 00000100:00100000:3.0:1790946459.873958:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 206 00000100:00100000:3.0:1790946459.873964:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec4ece38-7293-498c-8428-4d215a1f0fd0+10:2363:x1877943286506368:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790946459.873989:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec4ece38-7293-498c-8428-4d215a1f0fd0+10:2363:x1877943286506368:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 25us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946459.873996:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 206 00000100:00080000:1.0:1790946459.875060:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1790946459.889094:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790946460.621895:0:10125:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 09:07:38 (1790946458) === 00010000:00010000:3.0:1790946460.912949:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946461.116689:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946461.116818:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286506624 00000100:00100000:0.0:1790946461.116828:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286506624 00000100:00100000:0.0:1790946461.116918:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 207 00000100:00100000:0.0:1790946461.116927:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+10:8131:x1877943286506624:12345-192.168.203.13@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790946461.116942:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946461.116959:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff914680030a00/0x16e41aef93271d23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cbc5 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946461.116988:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff914680030a00/0x16e41aef93271d23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cbc5 expref: 11 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946461.117027:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff914680030a00/0x16e41aef93271d23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cbc5 expref: 11 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946461.117036:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914680030a00, rc 0) 00000100:00100000:0.0:1790946461.117089:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+11:8131:x1877943286506624:12345-192.168.203.13@tcp:101:mount.lustre.0 Request processed in 164us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946461.117096:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 207 00000100:00100000:1.0:1790946461.135691:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946461.136919:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286506752 00000100:00100000:2.0:1790946461.136934:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286506752 00000100:00100000:2.0:1790946461.137009:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 208 00000100:00100000:2.0:1790946461.137020:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec4ece38-7293-498c-8428-4d215a1f0fd0+11:8131:x1877943286506752:12345-192.168.203.13@tcp:501:mount.lustre.0 00000100:00100000:2.0:1790946461.137409:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec4ece38-7293-498c-8428-4d215a1f0fd0+11:8131:x1877943286506752:12345-192.168.203.13@tcp:501:mount.lustre.0 Request processed in 389us (1735us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946461.137417:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 208 00000100:00100000:1.0:1790946461.150816:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946461.151300:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286506880 00000100:00100000:2.0:1790946461.151311:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286506880 00000100:00100000:2.0:1790946461.151475:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 209 00000100:00100000:2.0:1790946461.151486:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec4ece38-7293-498c-8428-4d215a1f0fd0+11:8131:x1877943286506880:12345-192.168.203.13@tcp:503:mount.lustre.0 00000100:00100000:2.0:1790946461.151727:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec4ece38-7293-498c-8428-4d215a1f0fd0+11:8131:x1877943286506880:12345-192.168.203.13@tcp:503:mount.lustre.0 Request processed in 243us (1047us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946461.151735:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 209 00000100:00100000:1.0:1790946461.160733:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946461.160786:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286507008 00000100:00100000:0.0:1790946461.160795:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286507008 00000100:00100000:0.0:1790946461.160851:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 210 00000100:00100000:0.0:1790946461.160862:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+11:8135:x1877943286507008:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790946461.162834:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+11:8135:x1877943286507008:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 1965us (2101us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946461.162847:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 210 00000100:00100000:1.0:1790946461.195640:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946461.195723:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286507136 00000100:00100000:3.0:1790946461.195733:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286507136 00000100:00100000:3.0:1790946461.195785:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 211 00000100:00100000:3.0:1790946461.195796:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec4ece38-7293-498c-8428-4d215a1f0fd0+11:8135:x1877943286507136:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790946461.196677:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec4ece38-7293-498c-8428-4d215a1f0fd0+11:8135:x1877943286507136:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 879us (1042us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946461.196688:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 211 00000100:00100000:1.0:1790946461.203428:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946461.203518:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286507264 00000100:00100000:0.0:1790946461.203528:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286507264 00000100:00100000:0.0:1790946461.203574:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 212 00000100:00100000:0.0:1790946461.203583:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+11:8131:x1877943286507264:12345-192.168.203.13@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790946461.203601:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946461.203621:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff914680031a00/0x16e41aef93271d2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cbef expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946461.203649:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff914680031a00/0x16e41aef93271d2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cbef expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946461.203661:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff914680031a00/0x16e41aef93271d2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cbef expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946461.203683:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914680031a00, rc 0) 00000100:00100000:0.0:1790946461.203739:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+12:8131:x1877943286507264:12345-192.168.203.13@tcp:101:mount.lustre.0 Request processed in 156us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946461.203746:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 212 00000100:00100000:1.0:1790946461.210267:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946461.210448:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286507392 00000100:00100000:2.0:1790946461.210459:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286507392 00000100:00100000:2.0:1790946461.210556:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 213 00000100:00100000:2.0:1790946461.210567:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec4ece38-7293-498c-8428-4d215a1f0fd0+12:8131:x1877943286507392:12345-192.168.203.13@tcp:256:mount.lustre.0 20000000:01000000:2.0:1790946461.210590:0:5827:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1790946461.210615:0:5827:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1790946461.210624:0:5827:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1790946461.210627:0:5827:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1790946461.210630:0:5827:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1790946461.212441:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec4ece38-7293-498c-8428-4d215a1f0fd0+12:8131:x1877943286507392:12345-192.168.203.13@tcp:256:mount.lustre.0 Request processed in 1867us (2175us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946461.212455:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 213 00000100:00100000:1.0:1790946461.214942:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946461.215107:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286507520 00000100:00100000:3.0:1790946461.215117:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286507520 00000100:00100000:3.0:1790946461.215173:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 214 00000100:00100000:3.0:1790946461.215183:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec4ece38-7293-498c-8428-4d215a1f0fd0+12:8131:x1877943286507520:12345-192.168.203.13@tcp:101:mount.lustre.0 00010000:00010000:3.0:1790946461.215218:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946461.215237:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9146a032a400/0x16e41aef93271d31 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cbf6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946461.215281:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9146a032a400/0x16e41aef93271d31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cbf6 expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946461.215293:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9146a032a400/0x16e41aef93271d31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cbf6 expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946461.215303:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146a032a400, rc 0) 00000100:00100000:3.0:1790946461.215466:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:8131:x1877943286507520:12345-192.168.203.13@tcp:101:mount.lustre.0 Request processed in 283us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946461.215474:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 214 00000100:00100000:1.0:1790946461.218096:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946461.218227:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286507648 00000100:00100000:2.0:1790946461.218236:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286507648 00000100:00100000:2.0:1790946461.218287:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 215 00000100:00100000:2.0:1790946461.218297:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:8131:x1877943286507648:12345-192.168.203.13@tcp:501:mount.lustre.0 00000100:00100000:2.0:1790946461.218642:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:8131:x1877943286507648:12345-192.168.203.13@tcp:501:mount.lustre.0 Request processed in 346us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946461.218650:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 215 00000100:00100000:1.0:1790946461.221102:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946461.221469:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286507776 00000100:00100000:0.0:1790946461.221479:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286507776 00000100:00100000:0.0:1790946461.221529:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 216 00000100:00100000:0.0:1790946461.221538:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:8131:x1877943286507776:12345-192.168.203.13@tcp:503:mount.lustre.0 00000100:00100000:0.0:1790946461.221827:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:8131:x1877943286507776:12345-192.168.203.13@tcp:503:mount.lustre.0 Request processed in 289us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946461.221836:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 216 00000100:00100000:1.0:1790946461.226453:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946461.226583:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286507904 00000100:00100000:3.0:1790946461.226593:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286507904 00000100:00100000:3.0:1790946461.226647:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 217 00000100:00100000:3.0:1790946461.226656:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:8139:x1877943286507904:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790946461.226898:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:8139:x1877943286507904:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 242us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946461.226906:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 217 00000100:00100000:1.0:1790946461.238541:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946461.239474:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286508032 00000100:00100000:0.0:1790946461.239486:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286508032 00000100:00100000:0.0:1790946461.239550:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 218 00000100:00100000:0.0:1790946461.239559:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:8139:x1877943286508032:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790946461.239835:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:8139:x1877943286508032:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 276us (1302us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946461.239844:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 218 00000100:00100000:1.0:1790946461.243937:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946461.244044:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286508160 00000100:00100000:0.0:1790946461.244055:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286508160 00000100:00100000:0.0:1790946461.244100:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:0.0:1790946461.244108:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5eb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2360:x1877943286508160:12345-192.168.203.13@tcp:38:mount.lustre.0 00010000:00080000:0.0:1790946461.244136:0:5836:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 9afc1277-e08f-4ee9-9b29-b05bfc41dd4e@192.168.203.13@tcp t0 exp 0000000000000000 cur 246 last 0 00000020:00000080:0.0:1790946461.244175:0:5836:0:(genops.c:1384:class_connect()) connect: client 9afc1277-e08f-4ee9-9b29-b05bfc41dd4e, cookie 0x16e41aef93271d38 00000004:00100000:0.0:1790946461.244244:0:5836:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:0.0:1790946461.244513:0:5836:0:(import.c:65:import_set_state_nolock()) ffff914684982800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790946461.244574:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5eb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+6:2360:x1877943286508160:12345-192.168.203.13@tcp:38:mount.lustre.0 Request processed in 465us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946461.244582:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:1.0:1790946461.246183:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946461.246285:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286508544 00000100:00100000:3.0:1790946461.246293:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286508544 00000100:00100000:3.0:1790946461.246369:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 59 00000100:00100000:3.0:1790946461.246379:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5eb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2364:x1877943286508544:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790946461.246449:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5eb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2364:x1877943286508544:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 71us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946461.246457:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 59 00000100:00080000:1.0:1790946461.246925:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790946461.248719:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946461.248755:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946461.248824:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286508288 00000100:00100000:3.0:1790946461.248848:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286508288 00000100:00100000:3.0:1790946461.248949:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286508416 00000100:00100000:3.0:1790946461.248952:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286508416 00000100:00100000:3.0:1790946461.248971:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:3.0:1790946461.248980:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5eb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+7:0:x1877943286508288:12345-192.168.203.13@tcp:41:mount.lustre.0 00000004:00000024:3.0:1790946461.249029:0:5835:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1790946461.249126:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5eb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+7:0:x1877943286508288:12345-192.168.203.13@tcp:41:mount.lustre.0 Request processed in 147us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946461.249134:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:3.0:1790946461.249150:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:3.0:1790946461.249156:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5eb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+6:8131:x1877943286508416:12345-192.168.203.13@tcp:41:mount.lustre.0 00000004:00000024:3.0:1790946461.249168:0:5835:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1790946461.249187:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5eb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+6:8131:x1877943286508416:12345-192.168.203.13@tcp:41:mount.lustre.0 Request processed in 31us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946461.249193:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00080000:1.0:1790946461.249501:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790946461.251548:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946461.251627:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286508672 00000100:00100000:3.0:1790946461.251635:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286508672 00000100:00100000:3.0:1790946461.251687:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:3.0:1790946461.251697:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146befb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+6:8131:x1877943286508672:12345-192.168.203.13@tcp:40:mount.lustre.0 00000100:00100000:3.0:1790946461.251933:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146befb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+6:8131:x1877943286508672:12345-192.168.203.13@tcp:40:mount.lustre.0 Request processed in 238us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946461.251941:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:1.0:1790946461.254792:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946461.254833:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946461.256185:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946461.256794:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286509056 00000100:00100000:3.0:1790946461.256804:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286509056 00000100:00100000:3.0:1790946461.256865:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 1 00000100:00100000:3.0:1790946461.256875:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5eb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+6:8131:x1877943286509056:12345-192.168.203.13@tcp:33:mount.lustre.0 00000004:00200000:3.0:1790946461.256961:0:5837:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1790946461.257045:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5eb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+6:8131:x1877943286509056:12345-192.168.203.13@tcp:33:mount.lustre.0 Request processed in 171us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946461.257053:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 1 00000100:00100000:2.0:1790946461.257217:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286508800 00000100:00100000:2.0:1790946461.257223:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286508800 00000100:00100000:2.0:1790946461.257243:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286508928 00000100:00100000:2.0:1790946461.257246:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286508928 00000100:00100000:2.0:1790946461.257266:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:2.0:1790946461.257273:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5eb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2360:x1877943286508800:12345-192.168.203.13@tcp:8:mount.lustre.0 00010000:00080000:2.0:1790946461.257300:0:6673:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 9afc1277-e08f-4ee9-9b29-b05bfc41dd4e@192.168.203.13@tcp t0 exp 0000000000000000 cur 246 last 0 00000020:00000080:2.0:1790946461.257330:0:6673:0:(genops.c:1384:class_connect()) connect: client 9afc1277-e08f-4ee9-9b29-b05bfc41dd4e, cookie 0x16e41aef93271d3f 00002000:00100000:2.0:1790946461.257351:0:6673:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9afc1277-e08f-4ee9-9b29-b05bfc41dd4e/ffff9146856d7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790946461.257374:0:6673:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:2.0:1790946461.257572:0:6673:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1790946461.257601:0:6673:0:(import.c:65:import_set_state_nolock()) ffff9146856d3000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790946461.257652:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5eb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+6:2360:x1877943286508800:12345-192.168.203.13@tcp:8:mount.lustre.0 Request processed in 378us (2867us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946461.257659:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:2.0:1790946461.257677:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:2.0:1790946461.257682:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5eb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2360:x1877943286508928:12345-192.168.203.13@tcp:8:mount.lustre.0 00010000:00080000:2.0:1790946461.257699:0:6673:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 9afc1277-e08f-4ee9-9b29-b05bfc41dd4e@192.168.203.13@tcp t0 exp 0000000000000000 cur 246 last 0 00000020:00000080:2.0:1790946461.257715:0:6673:0:(genops.c:1384:class_connect()) connect: client 9afc1277-e08f-4ee9-9b29-b05bfc41dd4e, cookie 0x16e41aef93271d46 00002000:00100000:2.0:1790946461.257724:0:6673:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9afc1277-e08f-4ee9-9b29-b05bfc41dd4e/ffff9146856d0800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790946461.257736:0:6673:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:2.0:1790946461.257872:0:6673:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790946461.257885:0:6673:0:(import.c:65:import_set_state_nolock()) ffff9146856d0000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790946461.257912:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5eb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+6:2360:x1877943286508928:12345-192.168.203.13@tcp:8:mount.lustre.0 Request processed in 229us (3079us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946461.257918:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:2.0:1790946461.680560:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5fded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877943303318272:0@lo:400:kworker.0 00000100:00100000:2.0:1790946461.680672:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946461.680739:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5fdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303318784:0@lo:400:kworker.0 00000100:00100000:2.0:1790946461.680764:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946461.680796:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790946461.680802:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5fddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1877943303318400:0@lo:400:kworker.0 00000100:00100000:2.0:1790946461.680823:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946461.680852:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303318784 00000100:00100000:2.0:1790946461.680859:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303318784 00000100:00100000:2.0:1790946461.680912:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790946461.680922:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146befb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303318784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946461.680987:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146befb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303318784:12345-0@lo:400:kworker.0 Request processed in 66us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946461.680994:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1790946461.681035:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146b5fdfb80 x1877943303318784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790946477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946461.681047:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5fdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303318784:0@lo:400:kworker.0 00000100:00100000:0.0:1790946461.681310:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5fdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3303:1877943303318144:0@lo:400:kworker.0 00000100:00100000:0.0:1790946461.681355:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946461.681385:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1877943303318656:0@lo:400:kworker.0 00000100:00100000:0.0:1790946461.681425:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946461.681445:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790946461.681451:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5fdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303318528:0@lo:400:kworker.0 00000100:00100000:0.0:1790946461.681473:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946461.681506:0:6808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303318528 00000100:00100000:0.0:1790946461.681510:0:6808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303318528 00000100:00100000:0.0:1790946461.681539:0:6808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790946461.681556:0:6808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be077b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1877943303318528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946461.681602:0:6808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be077b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1877943303318528:12345-0@lo:400:kworker.0 Request processed in 56us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946461.681609:0:6808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1790946461.681636:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146b5fdd880 x1877943303318528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790946477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946461.681646:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5fdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303318528:0@lo:400:kworker.0 00000100:00100000:0.0:1790946461.681667:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303318272 00000100:00100000:0.0:1790946461.681670:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303318272 00000100:00100000:0.0:1790946461.681692:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303318400 00000100:00100000:0.0:1790946461.681695:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303318400 00000100:00100000:0.0:1790946461.681717:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303318656 00000100:00100000:0.0:1790946461.681721:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303318656 00000100:00100000:0.0:1790946461.681735:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1790946461.681740:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146befb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877943303318272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946461.681776:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146befb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877943303318272:12345-0@lo:400:kworker.0 Request processed in 35us (1104us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946461.681782:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1790946461.681793:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1790946461.681799:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146befb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1877943303318400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946461.681825:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146befb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1877943303318400:12345-0@lo:400:kworker.0 Request processed in 26us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946461.681831:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1790946461.681842:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790946461.681847:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be076300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877943303318656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946461.681877:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be076300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877943303318656:12345-0@lo:400:kworker.0 Request processed in 30us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946461.681883:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790946461.681907:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1877943303318656:0@lo:400:kworker.0 00000100:00100000:0.0:1790946461.681929:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5fddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1877943303318400:0@lo:400:kworker.0 00000100:00100000:0.0:1790946461.681939:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5fded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877943303318272:0@lo:400:kworker.0 00000100:00080000:1.0:1790946461.682356:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790946461.682361:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790946461.682364:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790946461.682573:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303318144 00000100:00100000:2.0:1790946461.682585:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303318144 00000100:00100000:2.0:1790946461.682619:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1790946461.682626:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3303:x1877943303318144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946461.682675:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3303:x1877943303318144:12345-0@lo:400:kworker.0 Request processed in 50us (1319us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946461.682681:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1790946461.682797:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5fdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3303:1877943303318144:0@lo:400:kworker.0 00010000:00010000:2.0:1790946461.940562:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946462.195189:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790946462.195240:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be075880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303318912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790946462.195309:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946462.195382:0:6676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303318912 00000100:00100000:0.0:1790946462.195389:0:6676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303318912 00000100:00100000:0.0:1790946462.195448:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790946462.195457:0:6676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be076a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303318912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790946462.195488:0:6676:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790946462.195531:0:6676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be076a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303318912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946462.195538:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1790946462.195576:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146be075880 x1877943303318912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790946478 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946462.195593:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be075880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303318912:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790946462.960478:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1790946463.309772:0:6700:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9afc1277-e08f-4ee9-9b29-b05bfc41dd4e 00000001:00100000:2.0:1790946463.328646:0:7645:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9afc1277-e08f-4ee9-9b29-b05bfc41dd4e 00010000:00010000:2.0:1790946463.986780:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946464.240568:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790946464.240592:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5eb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303319040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790946464.240663:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946464.240780:0:6676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303319040 00000100:00100000:0.0:1790946464.240789:0:6676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303319040 00000100:00100000:0.0:1790946464.240847:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790946464.240856:0:6676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5fdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877943303319040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790946464.240889:0:6676:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790946464.240936:0:6676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5fdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877943303319040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946464.240944:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1790946464.240983:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146b5eb2680 x1877943303319040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790946480 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946464.240999:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5eb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303319040:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1790946464.241167:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1790946464.340610:0:5857:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9afc1277-e08f-4ee9-9b29-b05bfc41dd4e 00010000:00010000:0.0:1790946465.008513:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946466.032530:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946466.533655:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946466.533697:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946466.533730:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946466.533757:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946466.533786:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946466.533814:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286509440 00000100:00100000:1.0:1790946466.533823:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286509440 00000100:00100000:1.0:1790946466.533876:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286509312 00000100:00100000:1.0:1790946466.533880:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286509312 00000100:00100000:1.0:1790946466.533901:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 63 00000100:00100000:1.0:1790946466.533910:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5eb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+5:2362:x1877943286509440:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790946466.533997:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5eb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+5:2362:x1877943286509440:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 87us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946466.534005:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 63 00000100:00100000:1.0:1790946466.534021:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 64 00000100:00100000:1.0:1790946466.534028:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5eb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2362:x1877943286509312:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790946466.534069:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5eb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2362:x1877943286509312:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 42us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946466.534076:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 64 00000100:00080000:1.0:1790946466.534093:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790946466.534479:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286509696 00000100:00100000:2.0:1790946466.534484:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286509696 00000100:00100000:2.0:1790946466.534525:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286509568 00000100:00100000:2.0:1790946466.534528:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286509568 00000100:00100000:2.0:1790946466.534550:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 36 00000100:00100000:2.0:1790946466.534557:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5eb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+5:2362:x1877943286509696:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790946466.534589:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5eb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+5:2362:x1877943286509696:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 33us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946466.534606:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 36 00000100:00100000:2.0:1790946466.534621:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 37 00000100:00100000:2.0:1790946466.534628:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5eb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+5:2362:x1877943286509568:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790946466.534654:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5eb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+5:2362:x1877943286509568:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 27us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946466.534660:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 37 00000100:00080000:1.0:1790946466.534907:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790946466.534911:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790946466.535184:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286509184 00000100:00100000:3.0:1790946466.535189:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286509184 00000100:00100000:3.0:1790946466.535573:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 220 00000100:00100000:3.0:1790946466.535581:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:2362:x1877943286509184:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790946466.535629:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:2362:x1877943286509184:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 49us (1995us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946466.535644:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 220 00000100:00100000:0.0:1790946466.801785:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be075c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877943303319296:0@lo:400:kworker.0 00000100:00100000:0.0:1790946466.801865:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946466.801930:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be075500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303319808:0@lo:400:kworker.0 00000100:00100000:0.0:1790946466.801959:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946466.802001:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790946466.802007:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be075180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1877943303319424:0@lo:400:kworker.0 00000100:00100000:0.0:1790946466.802029:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946466.802059:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303319808 00000100:00100000:0.0:1790946466.802066:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303319808 00000100:00100000:0.0:1790946466.802164:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790946466.802172:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b6318a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303319808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946466.802244:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b6318a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303319808:12345-0@lo:400:kworker.0 Request processed in 72us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946466.802250:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790946466.802274:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303319296 00000100:00100000:0.0:1790946466.802277:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303319296 00000100:00100000:3.0:1790946466.802648:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be075880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3303:1877943303319168:0@lo:400:kworker.0 00000100:00100000:3.0:1790946466.802694:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946466.802718:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be074380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1877943303319680:0@lo:400:kworker.0 00000100:00100000:3.0:1790946466.802739:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946466.802756:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790946466.802762:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be075f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303319552:0@lo:400:kworker.0 00000100:00100000:3.0:1790946466.802780:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946466.802804:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303319424 00000100:00100000:3.0:1790946466.802807:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303319424 00000100:00100000:3.0:1790946466.802830:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303319680 00000100:00100000:3.0:1790946466.802839:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303319680 00000100:00100000:3.0:1790946466.802856:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790946466.802861:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b6318e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1877943303319424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946466.802892:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b6318e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1877943303319424:12345-0@lo:400:kworker.0 Request processed in 30us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946466.802897:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790946466.802910:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1790946466.802916:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5fde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877943303319680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946466.802947:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5fde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877943303319680:12345-0@lo:400:kworker.0 Request processed in 31us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946466.802953:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1790946466.802983:0:6808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303319552 00000100:00100000:3.0:1790946466.802986:0:6808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303319552 00000100:00100000:3.0:1790946466.803011:0:6808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790946466.803017:0:6808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5fdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1877943303319552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946466.803045:0:6808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5fdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1877943303319552:12345-0@lo:400:kworker.0 Request processed in 28us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946466.803051:0:6808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1790946466.803087:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146be075f80 x1877943303319552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790946482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946466.803100:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be075f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303319552:0@lo:400:kworker.0 00000100:00100000:3.0:1790946466.803111:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be074380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1877943303319680:0@lo:400:kworker.0 00000100:00080000:3.0:1790946466.803153:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790946466.803158:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790946466.803160:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790946466.803183:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be075180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1877943303319424:0@lo:400:kworker.0 00010000:00080000:3.0:1790946466.803224:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146be075500 x1877943303319808/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790946482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946466.803234:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be075500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303319808:0@lo:400:kworker.0 00000100:00100000:0.0:1790946466.805857:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790946466.806265:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303319168 00000100:00100000:1.0:1790946466.806274:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303319168 00000100:00100000:1.0:1790946466.806336:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1790946466.806345:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3303:x1877943303319168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946466.806426:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3303:x1877943303319168:12345-0@lo:400:kworker.0 Request processed in 83us (3732us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946466.806433:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1790946466.806485:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be075880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3303:1877943303319168:0@lo:400:kworker.0 00000100:00100000:0.0:1790946466.806630:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b6319500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877943303319296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946466.806679:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b6319500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877943303319296:12345-0@lo:400:kworker.0 Request processed in 810us (4814us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946466.806686:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790946466.811971:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be075c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877943303319296:0@lo:400:kworker.0 00010000:00010000:0.0:1790946467.066837:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946467.315961:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5eb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303319936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790946467.316061:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946467.318443:0:6676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303319936 00000100:00100000:3.0:1790946467.318465:0:6676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303319936 00000100:00100000:3.0:1790946467.319157:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790946467.319172:0:6676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5fdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1877943303319936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790946467.319703:0:6676:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790946467.319823:0:6676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5fdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1877943303319936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 654us (3762us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946467.319833:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1790946467.319982:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146b5eb3800 x1877943303319936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790946483 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946467.320010:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5eb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303319936:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1790946467.864508:0:10320:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:3.0:1790946468.081582:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946469.109412:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946469.362625:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b631b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303320064:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790946469.362750:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946469.376460:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303320064 00000100:00100000:1.0:1790946469.376474:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303320064 00000100:00100000:1.0:1790946469.376542:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790946469.376554:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5fded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303320064:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1790946469.376558:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1790946469.376594:0:6678:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790946469.379543:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5fded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303320064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2969us (16771us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946469.379556:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1790946469.383432:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146b631b100 x1877943303320064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790946485 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946469.383471:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b631b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303320064:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790946470.130512:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946471.161856:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946471.648034:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946471.648081:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946471.648124:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946471.648154:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946471.648187:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946471.648276:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286510080 00000100:00100000:1.0:1790946471.648289:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286510080 00000100:00100000:1.0:1790946471.648359:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286509952 00000100:00100000:1.0:1790946471.648362:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286509952 00000100:00100000:1.0:1790946471.648389:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 68 00000100:00100000:1.0:1790946471.648401:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5eb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+5:2364:x1877943286510080:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790946471.648508:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5eb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+5:2364:x1877943286510080:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 109us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946471.648518:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 68 00000100:00100000:1.0:1790946471.648539:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 69 00000100:00100000:1.0:1790946471.648545:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2364:x1877943286509952:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790946471.648572:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2364:x1877943286509952:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 27us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946471.648578:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 69 00000100:00100000:3.0:1790946471.648924:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286509824 00000100:00100000:3.0:1790946471.648930:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286509824 00000100:00100000:3.0:1790946471.648986:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 222 00000100:00100000:3.0:1790946471.649006:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:2364:x1877943286509824:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790946471.649050:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:2364:x1877943286509824:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 47us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946471.649079:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 222 00000100:00100000:0.0:1790946471.651176:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286510336 00000100:00100000:0.0:1790946471.651239:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286510336 00000100:00100000:0.0:1790946471.651322:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286510208 00000100:00100000:0.0:1790946471.651327:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286510208 00000100:00100000:0.0:1790946471.651368:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 40 00000100:00100000:0.0:1790946471.651380:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5eb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+5:2364:x1877943286510336:12345-192.168.203.13@tcp:400:kworker.0 00000100:00080000:2.0:1790946471.652539:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790946471.652548:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790946471.652552:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790946471.652578:0:6808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 41 00000100:00100000:2.0:1790946471.652595:0:6808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+5:2364:x1877943286510208:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790946471.652693:0:6808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+5:2364:x1877943286510208:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 105us (4504us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946471.652701:0:6808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 41 00000100:00100000:0.0:1790946471.653380:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5eb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+5:2364:x1877943286510336:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 1998us (5250us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946471.653410:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 40 00000100:00100000:1.0:1790946471.921769:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877943303320320:0@lo:400:kworker.0 00000100:00100000:3.0:1790946471.922494:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303320576:0@lo:400:kworker.0 00000100:00100000:3.0:1790946471.922591:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946471.922654:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1790946471.922660:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3302:1877943303320192:0@lo:400:kworker.0 00000100:00100000:3.0:1790946471.922686:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946471.922709:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1877943303320704:0@lo:400:kworker.0 00000100:00100000:3.0:1790946471.922735:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946471.922965:0:6808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303320576 00000100:00100000:2.0:1790946471.922976:0:6808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303320576 00000100:00100000:2.0:1790946471.923053:0:6808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790946471.923063:0:6808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bec01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303320576:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1790946471.923163:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790946471.923395:0:6808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bec01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303320576:12345-0@lo:400:kworker.0 Request processed in 332us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946471.923403:0:6808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1790946471.923754:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146bee96300 x1877943303320576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790946487 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946471.923772:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303320576:0@lo:400:kworker.0 00000100:00100000:2.0:1790946471.928823:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303320192 00000100:00100000:2.0:1790946471.928844:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303320192 00000100:00100000:2.0:1790946471.928920:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1790946471.928933:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3302:x1877943303320192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946471.929055:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3302:x1877943303320192:12345-0@lo:400:kworker.0 Request processed in 125us (6367us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946471.929064:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1790946471.932449:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946471.932505:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3302:1877943303320192:0@lo:400:kworker.0 00000100:00100000:2.0:1790946471.932566:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303320704 00000100:00100000:2.0:1790946471.932576:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303320704 00000100:00100000:2.0:1790946471.932647:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303320320 00000100:00100000:2.0:1790946471.932650:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303320320 00000100:00100000:2.0:1790946471.932673:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1790946471.932683:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5fddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877943303320704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946471.932784:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5fddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877943303320704:12345-0@lo:400:kworker.0 Request processed in 101us (10047us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946471.932792:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1790946471.932806:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790946471.932813:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877943303320320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946471.932856:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877943303320320:12345-0@lo:400:kworker.0 Request processed in 33us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946471.932863:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:2.0:1790946471.932889:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790946471.932913:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1877943303320704:0@lo:400:kworker.0 00000100:00100000:1.0:1790946471.933288:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303320832:0@lo:400:kworker.0 00000100:00100000:1.0:1790946471.933353:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946471.933460:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1877943303320448:0@lo:400:kworker.0 00000100:00100000:0.0:1790946471.933511:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946471.933771:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303320832 00000100:00100000:2.0:1790946471.933777:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303320832 00000100:00100000:2.0:1790946471.933886:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790946471.933895:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303320832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946471.933943:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303320832:12345-0@lo:400:kworker.0 Request processed in 50us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946471.933950:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790946471.933969:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303320448 00000100:00100000:2.0:1790946471.933973:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303320448 00000100:00080000:3.0:1790946471.934344:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790946471.934350:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790946471.935296:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1790946471.935308:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b631a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1877943303320448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946471.935397:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b631a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1877943303320448:12345-0@lo:400:kworker.0 Request processed in 92us (1884us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946471.935404:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1790946471.935454:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1877943303320448:0@lo:400:kworker.0 00000100:00100000:1.0:1790946471.944912:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877943303320320:0@lo:400:kworker.0 00010000:00080000:1.0:1790946471.944976:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146bee95880 x1877943303320832/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790946487 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946471.944991:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303320832:0@lo:400:kworker.0 00010000:00010000:3.0:1790946472.186287:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946472.433792:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790946472.433824:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303320960:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790946472.433914:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946472.434174:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303320960 00000100:00100000:1.0:1790946472.434185:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303320960 00000100:00100000:1.0:1790946472.434273:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790946472.434283:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5fdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303320960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790946472.434328:0:6678:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790946472.434380:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5fdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303320960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946472.434388:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1790946472.434561:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146bee95880 x1877943303320960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790946488 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946472.434581:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303320960:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790946473.200410:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946474.229362:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946474.481563:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b631b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303321088:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790946474.481667:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946474.481881:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303321088 00000100:00100000:1.0:1790946474.481892:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303321088 00000100:00100000:1.0:1790946474.481978:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790946474.481990:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146befb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303321088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790946474.482047:0:6678:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790946474.482120:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146befb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303321088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946474.482128:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1790946474.482632:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146b631b800 x1877943303321088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790946490 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946474.482656:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b631b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303321088:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1790946474.484142:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790946475.249339:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946476.301922:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946476.772327:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946476.772367:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946476.772401:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946476.772426:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946476.772435:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286510720 00000100:00100000:1.0:1790946476.772448:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286510720 00000100:00100000:2.0:1790946476.772449:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946476.772472:0:6808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286510976 00000100:00100000:2.0:1790946476.772476:0:6808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286510976 00000100:00100000:2.0:1790946476.772514:0:6808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286510848 00000100:00100000:2.0:1790946476.772517:0:6808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286510848 00000100:00100000:1.0:1790946476.772521:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286510592 00000100:00100000:1.0:1790946476.772541:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286510592 00000100:00100000:2.0:1790946476.772542:0:6808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 44 00000100:00100000:2.0:1790946476.772555:0:6808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146befb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+5:2361:x1877943286510976:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790946476.772566:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 73 00000100:00100000:1.0:1790946476.772573:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146befb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+5:2361:x1877943286510720:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790946476.772654:0:6808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146befb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+5:2361:x1877943286510976:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 102us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946476.772664:0:6808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 44 00000100:00100000:2.0:1790946476.772686:0:6808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 45 00000100:00100000:2.0:1790946476.772694:0:6808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146befb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+5:2361:x1877943286510848:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790946476.772720:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286510464 00000100:00100000:3.0:1790946476.772725:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286510464 00000100:00100000:3.0:1790946476.772764:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 224 00000100:00100000:3.0:1790946476.772771:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:2361:x1877943286510464:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1790946476.772799:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 74 00000100:00100000:0.0:1790946476.772809:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146befb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2361:x1877943286510592:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790946476.772890:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146befb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+5:2361:x1877943286510720:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 317us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946476.772898:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 73 00000100:00100000:2.0:1790946476.780826:0:6808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146befb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+5:2361:x1877943286510848:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 8117us (8360us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946476.780846:0:6808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 45 00000100:00100000:0.0:1790946476.783349:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146befb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2361:x1877943286510592:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 10524us (10904us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946476.783367:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 74 00000100:00080000:2.0:1790946476.784275:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790946476.784284:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790946476.784289:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790946476.796100:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:2361:x1877943286510464:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 23312us (23772us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946476.796119:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 224 00000100:00100000:2.0:1790946477.043064:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146befb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1877943303321472:0@lo:400:kworker.0 00000100:00100000:2.0:1790946477.043163:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946477.043675:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146befb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877943303321344:0@lo:400:kworker.0 00000100:00100000:3.0:1790946477.043717:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946477.043741:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146befb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303321856:0@lo:400:kworker.0 00000100:00100000:3.0:1790946477.043771:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946477.043834:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303321472 00000100:00100000:3.0:1790946477.043843:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303321472 00000100:00100000:3.0:1790946477.043913:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303321344 00000100:00100000:3.0:1790946477.043916:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303321344 00000100:00100000:0.0:1790946477.044107:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146befb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303321600:0@lo:400:kworker.0 00000100:00100000:0.0:1790946477.044143:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946477.044170:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1790946477.044177:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146befb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3302:1877943303321216:0@lo:400:kworker.0 00000100:00100000:0.0:1790946477.044254:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946477.044664:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146befb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1877943303321728:0@lo:400:kworker.0 00000100:00100000:0.0:1790946477.044696:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946477.044829:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303321856 00000100:00100000:0.0:1790946477.044836:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303321856 00000100:00100000:0.0:1790946477.044882:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303321600 00000100:00100000:0.0:1790946477.044886:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303321600 00000100:00100000:0.0:1790946477.044915:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790946477.044925:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303321856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946477.045015:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303321856:12345-0@lo:400:kworker.0 Request processed in 91us (1242us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946477.045024:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790946477.045047:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790946477.045053:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b631b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303321600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946477.045087:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b631b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303321600:12345-0@lo:400:kworker.0 Request processed in 35us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946477.045093:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1790946477.045135:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146befb2300 x1877943303321600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790946493 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946477.045152:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146befb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303321600:0@lo:400:kworker.0 00000100:00100000:3.0:1790946477.045372:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1790946477.045390:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146befb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1877943303321472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946477.045440:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146befb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1877943303321472:12345-0@lo:400:kworker.0 Request processed in 56us (2278us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946477.047419:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1790946477.047447:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5fdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877943303321344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946477.047622:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5fdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877943303321344:12345-0@lo:400:kworker.0 Request processed in 189us (3904us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946477.047632:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1790946477.047670:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303321728 00000100:00100000:1.0:1790946477.047679:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303321728 00000100:00100000:1.0:1790946477.047717:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1790946477.047724:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b631a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877943303321728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946477.047778:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b631a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877943303321728:12345-0@lo:400:kworker.0 Request processed in 54us (3080us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946477.047785:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1790946477.050751:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146befb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1877943303321728:0@lo:400:kworker.0 00000100:00080000:1.0:1790946477.051082:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790946477.051092:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790946477.051095:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790946477.051552:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303321216 00000100:00100000:2.0:1790946477.051563:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303321216 00000100:00100000:2.0:1790946477.051638:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1790946477.051650:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3302:x1877943303321216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946477.051763:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3302:x1877943303321216:12345-0@lo:400:kworker.0 Request processed in 115us (7508us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946477.051772:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1790946477.052021:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146befb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3302:1877943303321216:0@lo:400:kworker.0 00000100:00100000:2.0:1790946477.053672:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146befb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877943303321344:0@lo:400:kworker.0 00010000:00080000:2.0:1790946477.053698:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146befb1880 x1877943303321856/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790946493 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946477.053721:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146befb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303321856:0@lo:400:kworker.0 00000100:00100000:3.0:1790946477.054134:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1790946477.054688:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146befb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1877943303321472:0@lo:400:kworker.0 00010000:00010000:1.0:1790946477.360359:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946477.552466:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790946477.552499:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5fdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303321984:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790946477.552596:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946477.552678:0:6676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303321984 00000100:00100000:3.0:1790946477.552688:0:6676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303321984 00000100:00100000:3.0:1790946477.552746:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790946477.552757:0:6676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5fdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303321984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790946477.552822:0:6676:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790946477.552893:0:6676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5fdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303321984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 137us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946477.552901:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1790946477.552953:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146b5fdf100 x1877943303321984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790946493 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946477.552977:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5fdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303321984:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790946478.384511:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946479.408460:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946479.607612:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b631aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303322112:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790946479.608618:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946479.610017:0:6676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303322112 00000100:00100000:3.0:1790946479.610032:0:6676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303322112 00000100:00100000:3.0:1790946479.610120:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790946479.610132:0:6676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b6318a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303322112:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1790946479.610163:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1790946479.610171:0:6676:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790946479.610281:0:6676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b6318a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303322112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 151us (1664us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946479.610287:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1790946479.610564:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146b631aa00 x1877943303322112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790946495 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946479.610592:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b631aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303322112:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790946480.435972:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946481.456327:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946481.891826:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946481.891866:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946481.891890:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946481.891923:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286511360 00000100:00100000:1.0:1790946481.891931:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286511360 00000100:00100000:1.0:1790946481.891977:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286511232 00000100:00100000:1.0:1790946481.891979:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286511232 00000100:00100000:1.0:1790946481.891996:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 78 00000100:00100000:1.0:1790946481.892005:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+5:2362:x1877943286511360:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790946481.892073:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+5:2362:x1877943286511360:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 68us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946481.892080:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 78 00000100:00100000:1.0:1790946481.892097:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 79 00000100:00100000:1.0:1790946481.892104:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2362:x1877943286511232:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790946481.892127:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2362:x1877943286511232:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 24us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946481.892133:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 79 00000100:00080000:1.0:1790946481.892163:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790946481.892655:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286511104 00000100:00100000:3.0:1790946481.892661:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286511104 00000100:00100000:3.0:1790946481.892698:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 226 00000100:00100000:3.0:1790946481.892705:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:2362:x1877943286511104:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790946481.892746:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:2362:x1877943286511104:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 41us (928us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946481.892752:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 226 00000100:00100000:1.0:1790946481.902196:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946481.902266:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946481.902295:0:6808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286511488 00000100:00100000:1.0:1790946481.902304:0:6808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286511488 00000100:00100000:1.0:1790946481.902365:0:6808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286511616 00000100:00100000:1.0:1790946481.902368:0:6808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286511616 00000100:00100000:1.0:1790946481.902391:0:6808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:1.0:1790946481.902400:0:6808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+5:2360:x1877943286511488:12345-192.168.203.13@tcp:9:kworker.0 00000020:00000080:1.0:1790946481.902430:0:6808:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x16e41aef93271d3f 00000100:00080000:1.0:1790946481.902441:0:6808:0:(import.c:65:import_set_state_nolock()) ffff9146856d3000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790946481.902503:0:6808:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1790946481.902829:0:6808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+2:2360:x1877943286511488:12345-192.168.203.13@tcp:9:kworker.0 Request processed in 429us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946481.902861:0:6808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:1.0:1790946481.902878:0:6808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00100000:1.0:1790946481.902885:0:6808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+5:2360:x1877943286511616:12345-192.168.203.13@tcp:9:kworker.0 00000020:00000080:1.0:1790946481.902898:0:6808:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x16e41aef93271d46 00000100:00080000:1.0:1790946481.902903:0:6808:0:(import.c:65:import_set_state_nolock()) ffff9146856d0000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790946481.902923:0:6808:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1790946481.903104:0:6808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+2:2360:x1877943286511616:12345-192.168.203.13@tcp:9:kworker.0 Request processed in 219us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946481.903111:0:6808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 15 00010000:00010000:1.0:1790946481.903136:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946481.903142:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790946481.903149:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790946481.903152:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790946482.160642:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1877943303322496:0@lo:400:kworker.0 00000100:00100000:2.0:1790946482.160726:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3303:1877943303322240:0@lo:400:kworker.0 00000100:00100000:3.0:1790946482.160788:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303322624:0@lo:400:kworker.0 00000100:00100000:1.0:1790946482.164341:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946482.164425:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1790946482.164436:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1877943303322368:0@lo:400:kworker.0 00000100:00100000:1.0:1790946482.164474:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946482.164498:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303322880:0@lo:400:kworker.0 00000100:00100000:1.0:1790946482.164521:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946482.164566:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303322496 00000100:00100000:1.0:1790946482.164572:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303322496 00000100:00100000:1.0:1790946482.164616:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303322368 00000100:00100000:1.0:1790946482.164619:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303322368 00000100:00100000:1.0:1790946482.164640:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1790946482.164647:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1877943303322496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946482.164717:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1877943303322496:12345-0@lo:400:kworker.0 Request processed in 70us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946482.164724:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1790946482.164740:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1790946482.164745:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1877943303322368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946482.164770:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1877943303322368:12345-0@lo:400:kworker.0 Request processed in 26us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946482.164776:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1790946482.164793:0:6808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303322880 00000100:00100000:1.0:1790946482.164796:0:6808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303322880 00000100:00100000:1.0:1790946482.164820:0:6808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790946482.164825:0:6808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1877943303322880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946482.164850:0:6808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1877943303322880:12345-0@lo:400:kworker.0 Request processed in 25us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946482.164856:0:6808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1790946482.164870:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790946482.164874:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790946482.164904:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1877943303322368:0@lo:400:kworker.0 00010000:00080000:1.0:1790946482.164916:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146bee96680 x1877943303322880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790946498 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946482.164926:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303322880:0@lo:400:kworker.0 00000100:00100000:1.0:1790946482.164934:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1877943303322496:0@lo:400:kworker.0 00000100:00100000:2.0:1790946482.165128:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946482.165155:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1877943303322752:0@lo:400:kworker.0 00000100:00100000:2.0:1790946482.165198:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946482.165341:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303322240 00000100:00100000:0.0:1790946482.165346:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303322240 00000100:00100000:0.0:1790946482.165381:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1790946482.165389:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3303:x1877943303322240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946482.165428:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3303:x1877943303322240:12345-0@lo:400:kworker.0 Request processed in 41us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946482.165435:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1790946482.165877:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3303:1877943303322240:0@lo:400:kworker.0 00000100:00100000:1.0:1790946482.165946:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303322752 00000100:00100000:1.0:1790946482.165950:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303322752 00000100:00100000:1.0:1790946482.165997:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1790946482.166016:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146befb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877943303322752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946482.166055:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146befb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877943303322752:12345-0@lo:400:kworker.0 Request processed in 41us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946482.166062:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:0.0:1790946482.166117:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790946482.166197:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1877943303322752:0@lo:400:kworker.0 00000100:00100000:3.0:1790946482.169756:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946482.177482:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303322624 00000100:00100000:1.0:1790946482.177499:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303322624 00000100:00080000:0.0:1790946482.177652:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790946482.177705:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790946482.177715:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5fdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303322624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946482.177815:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5fdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303322624:12345-0@lo:400:kworker.0 Request processed in 102us (8065us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946482.177822:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:0.0:1790946482.177898:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146bee94a80 x1877943303322624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790946498 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946482.177914:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303322624:0@lo:400:kworker.0 00010000:00010000:1.0:1790946482.480322:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946482.673045:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303323008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790946482.673118:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946482.678150:0:6676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303323008 00000100:00100000:1.0:1790946482.678162:0:6676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303323008 00000100:00100000:2.0:1790946482.679433:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790946482.679446:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146befb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1877943303323008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790946482.679485:0:6678:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790946482.679756:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146befb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1877943303323008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 313us (6637us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946482.679763:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1790946482.687347:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146bee95f80 x1877943303323008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790946498 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946482.687375:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303323008:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790946483.512645:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1790946483.779390:0:6700:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9afc1277-e08f-4ee9-9b29-b05bfc41dd4e 00000020:00000080:0.0:1790946483.779406:0:6700:0:(genops.c:885:class_export_put()) final put ffff9146856d7800/9afc1277-e08f-4ee9-9b29-b05bfc41dd4e 00000020:00000080:0.0:1790946483.780357:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9146856d7800/9afc1277-e08f-4ee9-9b29-b05bfc41dd4e for lustre-OST0000 00000020:00000080:0.0:1790946483.780415:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9146856d3000 for lustre-OST0000 00000001:00100000:1.0:1790946483.780739:0:7645:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9afc1277-e08f-4ee9-9b29-b05bfc41dd4e 00000020:00000080:1.0:1790946483.780745:0:7645:0:(genops.c:885:class_export_put()) final put ffff9146856d0800/9afc1277-e08f-4ee9-9b29-b05bfc41dd4e 00000020:00000080:0.0:1790946483.780791:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9146856d0800/9afc1277-e08f-4ee9-9b29-b05bfc41dd4e for lustre-OST0001 00000020:00000080:0.0:1790946483.780824:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9146856d0000 for lustre-OST0001 00010000:00010000:1.0:1790946484.529478:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946484.720572:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b631aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303323136:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790946484.720675:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946484.723276:0:6676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303323136 00000100:00100000:1.0:1790946484.723296:0:6676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303323136 00000100:00100000:1.0:1790946484.723386:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790946484.723397:0:6676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5fdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303323136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790946484.723450:0:6676:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1790946484.726721:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790946484.730769:0:6676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5fdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303323136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7358us (10079us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946484.730788:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1790946484.731703:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146b631aa00 x1877943303323136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790946500 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946484.731735:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b631aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303323136:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790946485.563085:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946486.579871:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946487.008546:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946487.008614:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946487.008645:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946487.008685:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286511872 00000100:00100000:3.0:1790946487.008697:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286511872 00000100:00100000:3.0:1790946487.008768:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286512000 00000100:00100000:3.0:1790946487.008772:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286512000 00000100:00100000:1.0:1790946487.010563:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 83 00000100:00100000:1.0:1790946487.010598:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be076680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2364:x1877943286511872:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790946487.010744:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be076680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2364:x1877943286511872:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 164us (2213us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946487.010753:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 83 00000100:00100000:1.0:1790946487.010784:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 84 00000100:00100000:1.0:1790946487.010806:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be074000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+5:2364:x1877943286512000:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790946487.010854:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be074000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+5:2364:x1877943286512000:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 50us (2208us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946487.010860:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 84 00000100:00100000:1.0:1790946487.010890:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286511744 00000100:00100000:1.0:1790946487.010899:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286511744 00000100:00100000:1.0:1790946487.012099:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 228 00000100:00100000:1.0:1790946487.012119:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:2364:x1877943286511744:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790946487.012484:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:2364:x1877943286511744:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 372us (3867us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946487.012493:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 228 00000100:00080000:3.0:1790946487.020011:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790946487.284391:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146befb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877943303323392:0@lo:400:kworker.0 00000100:00100000:1.0:1790946487.284391:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146befb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303323648:0@lo:400:kworker.0 00000100:00100000:0.0:1790946487.284475:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146befb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3303:1877943303323264:0@lo:400:kworker.0 00000100:00100000:3.0:1790946487.284547:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146befb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1877943303323520:0@lo:400:kworker.0 00000100:00100000:2.0:1790946487.288869:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946487.288983:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914682ead500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303323904:0@lo:400:kworker.0 00000100:00100000:2.0:1790946487.289348:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946487.289414:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303323392 00000100:00100000:2.0:1790946487.289424:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303323392 00000100:00100000:2.0:1790946487.289479:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1790946487.289490:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682eadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877943303323392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946487.289640:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682eadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877943303323392:12345-0@lo:400:kworker.0 Request processed in 152us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946487.289649:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1790946487.289679:0:6808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303323904 00000100:00100000:2.0:1790946487.289683:0:6808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303323904 00000100:00100000:2.0:1790946487.289725:0:6808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1790946487.289732:0:6808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682eafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303323904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946487.289769:0:6808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682eafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303323904:12345-0@lo:400:kworker.0 Request processed in 37us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946487.289776:0:6808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1790946487.289796:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790946487.289814:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946487.289862:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303323648 00000100:00100000:2.0:1790946487.289866:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303323648 00000100:00100000:2.0:1790946487.289896:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790946487.289904:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682eaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303323648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946487.289946:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682eaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303323648:12345-0@lo:400:kworker.0 Request processed in 43us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946487.289952:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1790946487.289969:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790946487.289982:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1790946487.290000:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146befb2300 x1877943303323648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790946503 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946487.290012:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146befb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1877943303323776:0@lo:400:kworker.0 00000100:00100000:2.0:1790946487.290016:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146befb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303323648:0@lo:400:kworker.0 00000100:00100000:0.0:1790946487.290039:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946487.291413:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303323264 00000100:00100000:2.0:1790946487.291428:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303323264 00000100:00100000:2.0:1790946487.291500:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1790946487.291511:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3303:x1877943303323264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946487.291616:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3303:x1877943303323264:12345-0@lo:400:kworker.0 Request processed in 108us (1633us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946487.291623:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1790946487.291658:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303323776 00000100:00100000:2.0:1790946487.291662:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303323776 00000100:00100000:2.0:1790946487.291699:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1790946487.291704:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b631b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877943303323776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946487.291736:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b631b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877943303323776:12345-0@lo:400:kworker.0 Request processed in 32us (1696us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946487.291742:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:2.0:1790946487.291759:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790946487.292807:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946487.293943:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146befb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877943303323392:0@lo:400:kworker.0 00010000:00080000:1.0:1790946487.293971:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff914682ead500 x1877943303323904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790946503 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946487.293986:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914682ead500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303323904:0@lo:400:kworker.0 00000100:00100000:0.0:1790946487.294823:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146befb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3303:1877943303323264:0@lo:400:kworker.0 00000100:00100000:0.0:1790946487.294847:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146befb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1877943303323776:0@lo:400:kworker.0 00000100:00100000:2.0:1790946487.296453:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303323520 00000100:00100000:2.0:1790946487.296470:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303323520 00000100:00100000:2.0:1790946487.296569:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1790946487.296582:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be077b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1877943303323520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946487.296711:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be077b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1877943303323520:12345-0@lo:400:kworker.0 Request processed in 130us (3909us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946487.296719:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1790946487.296773:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146befb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1877943303323520:0@lo:400:kworker.0 00000100:00080000:0.0:1790946487.296896:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1790946487.600767:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946487.795004:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303324032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790946487.795103:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946487.795365:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303324032 00000100:00100000:1.0:1790946487.795377:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303324032 00000100:00100000:1.0:1790946487.795447:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1790946487.795470:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682ead500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1877943303324032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790946487.795622:0:6678:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790946487.795761:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682ead500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1877943303324032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 292us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946487.795770:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1790946487.795929:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146bee96680 x1877943303324032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790946503 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946487.795952:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303324032:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790946488.626837:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790946489.202581:0:11023:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1790946489.651168:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946489.840529:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be075c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303324160:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790946489.840637:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946489.840727:0:6676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303324160 00000100:00100000:3.0:1790946489.840735:0:6676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303324160 00000100:00100000:3.0:1790946489.840797:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790946489.840807:0:6676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be075880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303324160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790946489.840850:0:6676:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790946489.840893:0:6676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be075880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303324160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946489.840899:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1790946489.840988:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146be075c00 x1877943303324160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790946505 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946489.841021:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be075c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303324160:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1790946489.841024:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790946490.672335:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946491.707130:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946492.132474:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946492.132525:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946492.132589:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946492.133788:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286512128 00000100:00100000:2.0:1790946492.133804:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286512128 00000100:00100000:2.0:1790946492.133877:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 230 00000100:00100000:2.0:1790946492.133888:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:2361:x1877943286512128:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790946492.133989:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:2361:x1877943286512128:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 102us (1530us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946492.133999:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 230 00000100:00100000:2.0:1790946492.134048:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286512384 00000100:00100000:2.0:1790946492.134052:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286512384 00000100:00100000:2.0:1790946492.134099:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286512256 00000100:00100000:2.0:1790946492.134103:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286512256 00000100:00100000:2.0:1790946492.134140:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 88 00000100:00100000:2.0:1790946492.134149:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b631aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+5:2361:x1877943286512384:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790946492.134628:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b631aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+5:2361:x1877943286512384:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 480us (2102us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946492.134637:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 88 00000100:00100000:2.0:1790946492.134653:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 89 00000100:00100000:2.0:1790946492.134661:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146875b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2361:x1877943286512256:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790946492.134688:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146875b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2361:x1877943286512256:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 28us (2100us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946492.134694:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 89 00000100:00080000:2.0:1790946492.134869:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790946492.401438:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146befb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877943303324416:0@lo:400:kworker.0 00000100:00100000:3.0:1790946492.401445:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146befb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303324672:0@lo:400:kworker.0 00000100:00100000:0.0:1790946492.401534:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146befb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3303:1877943303324288:0@lo:400:kworker.0 00000100:00100000:2.0:1790946492.401641:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946492.401701:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914685636300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303324928:0@lo:400:kworker.0 00000100:00100000:2.0:1790946492.401725:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946492.402400:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790946492.402411:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146befb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1877943303324544:0@lo:400:kworker.0 00000100:00100000:2.0:1790946492.402451:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946492.402499:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303324416 00000100:00100000:2.0:1790946492.402508:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303324416 00000100:00100000:2.0:1790946492.402559:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303324544 00000100:00100000:2.0:1790946492.402563:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303324544 00000100:00100000:2.0:1790946492.402591:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1790946492.402599:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914685635180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877943303324416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946492.402728:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914685635180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877943303324416:12345-0@lo:400:kworker.0 Request processed in 129us (1094us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946492.402736:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1790946492.403987:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1790946492.404003:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914685635500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1877943303324544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946492.404077:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914685635500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1877943303324544:12345-0@lo:400:kworker.0 Request processed in 80us (1626us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946492.404084:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1790946492.404127:0:6808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303324928 00000100:00100000:2.0:1790946492.404134:0:6808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303324928 00000100:00100000:2.0:1790946492.404179:0:6808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790946492.404185:0:6808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914685636d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303324928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946492.404237:0:6808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914685636d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303324928:12345-0@lo:400:kworker.0 Request processed in 52us (2510us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946492.404243:0:6808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1790946492.404280:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790946492.404285:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790946492.404333:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146befb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1877943303324544:0@lo:400:kworker.0 00000100:00100000:2.0:1790946492.404347:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146befb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877943303324416:0@lo:400:kworker.0 00010000:00080000:2.0:1790946492.404361:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff914685636300 x1877943303324928/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790946508 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946492.404372:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914685636300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303324928:0@lo:400:kworker.0 00000100:00100000:3.0:1790946492.407549:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946492.407984:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303324672 00000100:00100000:2.0:1790946492.408007:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303324672 00000100:00100000:2.0:1790946492.408428:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790946492.408442:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be075500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303324672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946492.408536:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be075500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303324672:12345-0@lo:400:kworker.0 Request processed in 98us (999us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946492.408545:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:3.0:1790946492.409067:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790946492.409637:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146befb3b80 x1877943303324672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790946508 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946492.409657:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146befb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303324672:0@lo:400:kworker.0 00000100:00100000:3.0:1790946492.414189:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946492.414284:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146befb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1877943303324800:0@lo:400:kworker.0 00000100:00100000:3.0:1790946492.414333:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946492.414516:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303324800 00000100:00100000:2.0:1790946492.414528:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303324800 00000100:00100000:2.0:1790946492.414655:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1790946492.414680:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be075180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877943303324800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946492.414753:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be075180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877943303324800:12345-0@lo:400:kworker.0 Request processed in 88us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946492.414763:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:3.0:1790946492.414826:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790946492.414866:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146befb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1877943303324800:0@lo:400:kworker.0 00000100:00100000:1.0:1790946492.415272:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303324288 00000100:00100000:1.0:1790946492.415278:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303324288 00000100:00100000:1.0:1790946492.415334:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1790946492.415343:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3303:x1877943303324288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946492.415402:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3303:x1877943303324288:12345-0@lo:400:kworker.0 Request processed in 60us (1225us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946492.415408:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1790946492.415517:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146befb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3303:1877943303324288:0@lo:400:kworker.0 00010000:00010000:2.0:1790946492.722418:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946492.918063:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790946492.918096:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303325056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790946492.918254:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946492.918381:0:6676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303325056 00000100:00100000:0.0:1790946492.918398:0:6676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303325056 00000100:00100000:0.0:1790946492.918464:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790946492.918474:0:6676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be074380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303325056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790946492.918519:0:6676:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790946492.918596:0:6676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be074380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303325056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946492.918604:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1790946492.918831:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146bee95500 x1877943303325056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790946508 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946492.918855:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303325056:0@lo:13:osp-pre-1-0.0 00000020:00000080:3.0:1790946493.272260:0:11171:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd74ff60d0 20000000:00000080:3.0:1790946493.272286:0:11171:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9146beff7800 uarg=0000000000000000 20000000:01000000:3.0:1790946493.272336:0:11171:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1790946493.272343:0:11171:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1790946493.272350:0:11171:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1790946493.276424:0:11172:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1790946493.277128:0:11171:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1790946493.287270:0:11171:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1790946493.287343:0:11171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9146a032a800/0x16e41aef93271d4d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946493.288549:0:11171:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff914688aeea00/0x16e41aef93271cf2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cbbe expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946493.288636:0:11171:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff914688aeee00/0x16e41aef93271d00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93271cf9 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946493.288643:0:11171:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9146b180fc00/0x16e41aef93271d0e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93271d07 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946493.288649:0:11171:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff914688aef800/0x16e41aef93271d1c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93271d15 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946493.288656:0:11171:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9146a032a400/0x16e41aef93271d31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cbf6 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946493.288666:0:11171:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9146a032a800/0x16e41aef93271d4d lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946493.288923:0:11171:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9146a032a400/0x16e41aef93271d31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cbf6 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946493.288940:0:11171:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9146a032a400/0x16e41aef93271d31 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cbf6 expref: 12 pid: 5828 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946493.288960:0:11171:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be075f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11171:1877943303325184:192.168.203.13@tcp:104: 00010000:00010000:3.0:1790946493.289176:0:11171:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff914688aef800/0x16e41aef93271d1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x16e41aef93271d15 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946493.289231:0:11171:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff914688aef800/0x16e41aef93271d1c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x16e41aef93271d15 expref: 18 pid: 5828 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946493.289243:0:11171:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be075c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11171:1877943303325312:0@lo:104: 00000100:00100000:3.0:1790946493.289314:0:11171:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946493.293268:0:6689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303325312 00000100:00100000:0.0:1790946493.293292:0:6689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303325312 00000100:00100000:0.0:1790946493.293861:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790946493.293875:0:6689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beee7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+3:11171:x1877943303325312:12345-0@lo:104: 00010000:00010000:0.0:1790946493.293899:0:6689:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9146b180fa00/0x16e41aef93271d15 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93271d1c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946493.294033:0:6689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790946493.294039:0:6689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beee7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+3:11171:x1877943303325312:12345-0@lo:104: Request processed in 169us (4727us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946493.294048:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:2.0:1790946493.294123:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946493.294131:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9146b180fa00/0x16e41aef93271d15 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93271d1c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946493.294140:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180fa00 already unused, calling callback (ffffffffc1d96c20) 10000000:00010000:2.0:1790946493.294164:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9146b180fa00/0x16e41aef93271d15 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x16e41aef93271d1c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946493.294177:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9146b180fa00/0x16e41aef93271d15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x16e41aef93271d1c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790946493.294184:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9146b180fa00/0x16e41aef93271d15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x16e41aef93271d1c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790946493.294191:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790946493.294259:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9146b180fa00/0x16e41aef93271d15 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271d1c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946493.294266:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790946493.294292:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9146b180fa00/0x16e41aef93271d15 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271d1c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946493.294299:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9146b180fa00/0x16e41aef93271d15 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271d1c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946493.294315:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946493.294317:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946493.294318:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946493.294347:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914685636300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3302:1877943303325440:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790946493.294513:0:11171:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9146b180fc00/0x16e41aef93271d0e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x16e41aef93271d07 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946493.294528:0:11171:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9146b180fc00/0x16e41aef93271d0e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x16e41aef93271d07 expref: 18 pid: 5828 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946493.294539:0:11171:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146beee5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11171:1877943303325568:0@lo:104: 00000100:00100000:3.0:1790946493.294594:0:11171:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946493.294715:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946493.294778:0:5820:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303325440 00000100:00100000:2.0:1790946493.294785:0:5820:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303325440 00010000:00010000:2.0:1790946493.294813:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff914688aef800/0x16e41aef93271d1c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef93271d15 expref: 19 pid: 5828 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946493.294840:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790946493.294857:0:5820:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914685714050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3302:x1877943303325440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790946493.294872:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790946493.294878:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff914688aef800/0x16e41aef93271d1c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef93271d15 expref: 19 pid: 5828 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946493.294887:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff914688aef800/0x16e41aef93271d1c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x16e41aef93271d15 expref: 19 pid: 5828 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946493.294906:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790946493.294938:0:5820:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914685714050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3302:x1877943303325440:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946493.294946:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790946493.295024:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914685636300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3302:1877943303325440:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790946493.298571:0:11171:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff914688aeee00/0x16e41aef93271d00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x16e41aef93271cf9 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946493.298595:0:11171:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff914688aeee00/0x16e41aef93271d00 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x16e41aef93271cf9 expref: 18 pid: 5827 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946493.298613:0:11171:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146beee4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11171:1877943303325696:0@lo:104: 00000100:00100000:3.0:1790946493.298930:0:11171:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946493.298974:0:6689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303325568 00000100:00100000:0.0:1790946493.298987:0:6689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303325568 00000100:00100000:0.0:1790946493.299056:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790946493.299085:0:6689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beee5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+3:11171:x1877943303325568:12345-0@lo:104: 00010000:00010000:0.0:1790946493.299121:0:6689:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff914688aee600/0x16e41aef93271d07 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93271d0e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946493.299187:0:6689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790946493.299194:0:6689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beee5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+3:11171:x1877943303325568:12345-0@lo:104: Request processed in 112us (4600us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946493.299216:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790946493.299361:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00010000:00010000:2.0:1790946493.303005:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946493.303026:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff914688aee600/0x16e41aef93271d07 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93271d0e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946493.303042:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aee600 already unused, calling callback (ffffffffc1d96c20) 10000000:00010000:2.0:1790946493.303047:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff914688aee600/0x16e41aef93271d07 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x16e41aef93271d0e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946493.303060:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff914688aee600/0x16e41aef93271d07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x16e41aef93271d0e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790946493.303069:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff914688aee600/0x16e41aef93271d07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x16e41aef93271d0e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790946493.303075:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790946493.303166:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff914688aee600/0x16e41aef93271d07 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271d0e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946493.303193:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790946493.303243:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff914688aee600/0x16e41aef93271d07 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271d0e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946493.303251:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff914688aee600/0x16e41aef93271d07 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271d0e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946493.303259:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914685636300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3303:1877943303325824:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790946493.303271:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946493.303274:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946493.303276:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946493.303295:0:5819:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286512512 00000100:00100000:2.0:1790946493.303305:0:5819:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286512512 00010000:00010000:2.0:1790946493.303345:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9146a032a400/0x16e41aef93271d31 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cbf6 expref: 13 pid: 5828 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946493.303362:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790946493.303540:0:11171:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff914688aeea00/0x16e41aef93271cf2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cbbe expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946493.303556:0:11171:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff914688aeea00/0x16e41aef93271cf2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cbbe expref: 13 pid: 5828 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946493.303661:0:11171:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146beee6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11171:1877943303325952:192.168.203.13@tcp:104: 00000100:00100000:3.0:1790946493.303868:0:11171:0:(client.c:2716:ptlrpc_set_wait()) set ffff91468758c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790946493.303897:0:11171:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be075f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11171:1877943303325184:192.168.203.13@tcp:104: 00010000:00010000:3.0:1790946493.303910:0:11171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff914688aef800/0x16e41aef93271d1c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x16e41aef93271d15 expref: 18 pid: 5828 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946493.303923:0:11171:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be075c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11171:1877943303325312:0@lo:104: 00000100:00100000:3.0:1790946493.303932:0:11171:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146beee5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11171:1877943303325568:0@lo:104: 00000100:00100000:3.0:1790946493.304128:0:6689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303325696 00000100:00100000:3.0:1790946493.304135:0:6689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303325696 00000100:00100000:3.0:1790946493.304171:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790946493.304181:0:6689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beee7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+3:11171:x1877943303325696:12345-0@lo:104: 00010000:00010000:3.0:1790946493.304193:0:6689:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9146b180f000/0x16e41aef93271cf9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93271d00 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946493.304278:0:6689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790946493.304284:0:6689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beee7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+3:11171:x1877943303325696:12345-0@lo:104: Request processed in 105us (5355us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946493.304292:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790946493.304335:0:11171:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146beee4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11171:1877943303325696:0@lo:104: 00010000:00010000:3.0:1790946493.304352:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790946493.304358:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9146b180f000/0x16e41aef93271cf9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93271d00 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946493.304434:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180f000 already unused, calling callback (ffffffffc1d96c20) 10000000:00010000:3.0:1790946493.304439:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9146b180f000/0x16e41aef93271cf9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x16e41aef93271d00 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946493.304448:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9146b180f000/0x16e41aef93271cf9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x16e41aef93271d00 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790946493.304464:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9146b180f000/0x16e41aef93271cf9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x16e41aef93271d00 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790946493.304471:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790946493.304496:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9146b180f000/0x16e41aef93271cf9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271d00 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946493.304502:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790946493.304519:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9146b180f000/0x16e41aef93271cf9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271d00 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946493.304526:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9146b180f000/0x16e41aef93271cf9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271d00 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946493.304543:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946493.304545:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946493.304546:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946493.304556:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146beee6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3300:1877943303326080:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790946493.311546:0:5819:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303325824 00000100:00100000:2.0:1790946493.311643:0:5819:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303325824 00010000:00010000:2.0:1790946493.311794:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9146b180fc00/0x16e41aef93271d0e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef93271d07 expref: 18 pid: 5828 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946493.311849:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 26 00000100:00100000:2.0:1790946493.311861:0:5819:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146875b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:2364:x1877943286512512:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790946493.311881:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790946493.311891:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9146a032a400/0x16e41aef93271d31 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cbf6 expref: 13 pid: 5828 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946493.311908:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9146a032a400/0x16e41aef93271d31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cbf6 expref: 13 pid: 5828 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946493.311958:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9146a032a400/0x16e41aef93271d31 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cbf6 expref: 13 pid: 5828 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946493.311979:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790946493.312082:0:5819:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146875b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec4ece38-7293-498c-8428-4d215a1f0fd0+12:2364:x1877943286512512:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 223us (12723us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946493.312090:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 26 00000100:00100000:2.0:1790946493.312122:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790946493.312129:0:5819:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146875b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+18:3303:x1877943303325824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790946493.312137:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790946493.312142:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9146b180fc00/0x16e41aef93271d0e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef93271d07 expref: 18 pid: 5828 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946493.312150:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9146b180fc00/0x16e41aef93271d0e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x16e41aef93271d07 expref: 18 pid: 5828 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946493.312161:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9146b180fc00/0x16e41aef93271d0e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x16e41aef93271d07 expref: 18 pid: 5828 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946493.312171:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790946493.312255:0:5819:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146875b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+17:3303:x1877943303325824:12345-0@lo:103:ldlm_bl.0 Request processed in 126us (8894us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946493.312261:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790946493.313822:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946493.313903:0:5819:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303326080 00000100:00100000:2.0:1790946493.313912:0:5819:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303326080 00010000:00010000:2.0:1790946493.313952:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff914688aeee00/0x16e41aef93271d00 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef93271cf9 expref: 17 pid: 5827 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946493.313958:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914685636300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3303:1877943303325824:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790946493.314007:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790946493.314017:0:5819:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914685634e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+17:3300:x1877943303326080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790946493.314031:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790946493.314038:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff914688aeee00/0x16e41aef93271d00 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef93271cf9 expref: 17 pid: 5827 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946493.314050:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff914688aeee00/0x16e41aef93271d00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x16e41aef93271cf9 expref: 17 pid: 5827 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946493.314067:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff914688aeee00/0x16e41aef93271d00 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x16e41aef93271cf9 expref: 17 pid: 5827 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946493.314083:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790946493.315062:0:5819:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914685634e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+16:3300:x1877943303326080:12345-0@lo:103:ldlm_bl.0 Request processed in 1040us (1243us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946493.315074:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790946493.315544:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146beee6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3300:1877943303326080:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790946493.317928:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946493.318171:0:5821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286512640 00000100:00100000:2.0:1790946493.318186:0:5821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286512640 00010000:00010000:2.0:1790946493.318331:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff914688aeea00/0x16e41aef93271cf2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cbbe expref: 12 pid: 5828 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946493.318476:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 29 00000100:00100000:2.0:1790946493.318488:0:5821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146875b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec4ece38-7293-498c-8428-4d215a1f0fd0+12:2363:x1877943286512640:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790946493.318521:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790946493.318528:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff914688aeea00/0x16e41aef93271cf2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cbbe expref: 12 pid: 5828 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946493.318634:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff914688aeea00/0x16e41aef93271cf2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cbbe expref: 12 pid: 5828 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946493.318663:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9146a032a800/0x16e41aef93271d4d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946493.318747:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9146a032a800/0x16e41aef93271d4d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946493.318770:0:5821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9146a032a800/0x16e41aef93271d4d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946493.318778:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9146a032a800/0x16e41aef93271d4d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946493.318786:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9146a032a800/0x16e41aef93271d4d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946493.318793:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9146a032a800/0x16e41aef93271d4d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946493.318800:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146a032a800 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:2.0:1790946493.318805:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9146a032a800/0x16e41aef93271d4d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946493.318813:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9146a032a800/0x16e41aef93271d4d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946493.318822:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9146a032a800/0x16e41aef93271d4d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946493.318845:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790946493.318916:0:5821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146875b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec4ece38-7293-498c-8428-4d215a1f0fd0+12:2363:x1877943286512640:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 430us (1004us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946493.318924:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 29 00010000:00010000:3.0:1790946493.320814:0:11171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff914688aeea00/0x16e41aef93271cf2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cbbe expref: 11 pid: 5828 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946493.320845:0:11171:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146beee6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11171:1877943303325952:192.168.203.13@tcp:104: 00010000:00010000:3.0:1790946493.321021:0:11171:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9146a032a800/0x16e41aef93271d4d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946493.321035:0:11171:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9146a032a800/0x16e41aef93271d4d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946493.321066:0:11171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9146a032a800/0x16e41aef93271d4d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946493.321230:0:11171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9146a032a800/0x16e41aef93271d4d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946493.746020:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946494.768623:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946494.970039:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303326208:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790946494.970165:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946494.971421:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303326208 00000100:00100000:1.0:1790946494.971440:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303326208 00000100:00100000:1.0:1790946494.972008:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1790946494.972021:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1877943303326208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790946494.972397:0:6678:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1790946494.972604:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790946494.973618:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1877943303326208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1592us (3446us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946494.973634:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1790946494.974319:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146bee95500 x1877943303326208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790946510 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946494.974351:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303326208:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790946495.007712:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946495.007804:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286512768 00000100:00100000:3.0:1790946495.007819:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286512768 00000100:00100000:3.0:1790946495.007883:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 232 00000100:00100000:3.0:1790946495.007895:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec4ece38-7293-498c-8428-4d215a1f0fd0+11:5602:x1877943286512768:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790946495.007918:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946495.007943:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9146a032a800/0x16e41aef93271d54 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cc20 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946495.007982:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9146a032a800/0x16e41aef93271d54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc20 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946495.007995:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9146a032a800/0x16e41aef93271d54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc20 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946495.008005:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146a032a800, rc 0) 00000100:00100000:3.0:1790946495.008100:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec4ece38-7293-498c-8428-4d215a1f0fd0+12:5602:x1877943286512768:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 Request processed in 207us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946495.008108:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 232 00000100:00100000:2.0:1790946495.018667:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946495.021986:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286512896 00000100:00100000:3.0:1790946495.022008:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286512896 00000100:00100000:1.0:1790946495.023773:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 233 00000100:00100000:1.0:1790946495.023788:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+12:5602:x1877943286512896:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790946495.024628:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+12:5602:x1877943286512896:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 Request processed in 836us (5968us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946495.024640:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 233 00000100:00100000:1.0:1790946495.041442:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946495.041999:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286513024 00000100:00100000:2.0:1790946495.042014:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286513024 00000100:00100000:2.0:1790946495.042105:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 234 00000100:00100000:2.0:1790946495.042116:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec4ece38-7293-498c-8428-4d215a1f0fd0+12:5602:x1877943286513024:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790946495.044719:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec4ece38-7293-498c-8428-4d215a1f0fd0+12:5602:x1877943286513024:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 Request processed in 2586us (3275us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946495.044740:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 234 00000100:00100000:3.0:1790946495.055055:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946495.055759:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286513152 00000100:00100000:1.0:1790946495.055774:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286513152 00000100:00100000:1.0:1790946495.055841:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 235 00000100:00100000:1.0:1790946495.055852:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+12:5602:x1877943286513152:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790946495.055876:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946495.055899:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9146b180fa00/0x16e41aef93271d5b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cc27 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946495.055941:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9146b180fa00/0x16e41aef93271d5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc27 expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946495.055956:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9146b180fa00/0x16e41aef93271d5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc27 expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946495.055967:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b180fa00, rc 0) 00000100:00100000:1.0:1790946495.058566:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:5602:x1877943286513152:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 Request processed in 2697us (3509us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946495.058582:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 235 00000100:00100000:0.0:1790946495.066517:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946495.067162:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286513280 00000100:00100000:1.0:1790946495.067176:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286513280 00000100:00100000:1.0:1790946495.067272:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 236 00000100:00100000:1.0:1790946495.067305:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:5602:x1877943286513280:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790946495.067833:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:5602:x1877943286513280:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 Request processed in 529us (1330us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946495.067843:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 236 00000100:00100000:3.0:1790946495.079287:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946495.079606:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286513408 00000100:00100000:1.0:1790946495.079618:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286513408 00000100:00100000:1.0:1790946495.079683:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 237 00000100:00100000:1.0:1790946495.079695:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:5602:x1877943286513408:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790946495.080773:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:5602:x1877943286513408:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 Request processed in 1072us (1493us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946495.080785:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 237 10000000:01000000:3.0:1790946495.281915:0:5831:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790946495.281925:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9145853b6000 from 7 10000000:01000000:3.0:1790946495.281931:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790946495.282012:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146a032b400/0x16e41aef93271d62 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946495.282029:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9146a032b400/0x16e41aef93271d62 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946495.282043:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9146a032b400/0x16e41aef93271d62 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946495.282079:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146beee6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303326336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790946495.282192:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946495.282292:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff914688abcd80 going to sleep for 11 seconds 00000100:00100000:1.0:1790946495.282596:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303326336 00000100:00100000:1.0:1790946495.282607:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303326336 00000100:00100000:1.0:1790946495.282689:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1790946495.282702:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+16:5831:x1877943303326336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790946495.282733:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946495.282751:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9146b180ee00/0x16e41aef93271d69 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x16e41aef93271d62 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946495.282784:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9146b180ee00/0x16e41aef93271d69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x16e41aef93271d62 expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946495.282798:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9146b180ee00/0x16e41aef93271d69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93271d62 expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946495.282809:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b180ee00, rc 0) 00000100:00100000:1.0:1790946495.282874:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+17:5831:x1877943303326336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 175us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946495.282900:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1790946495.283711:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146beee6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303326336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790946495.283740:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9146a032b400/0x16e41aef93271d62 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271d69 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946495.283753:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9146a032b400/0x16e41aef93271d62 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93271d69 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946495.283862:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914685637100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303326464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790946495.283915:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946495.283962:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146b6328840 going to sleep for 11 seconds 00000100:00100000:1.0:1790946495.284426:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303326464 00000100:00100000:1.0:1790946495.284436:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303326464 00000100:00100000:1.0:1790946495.284490:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1790946495.284499:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+17:5831:x1877943303326464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790946495.285287:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+17:5831:x1877943303326464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 785us (1368us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946495.285298:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1790946495.285441:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914685637100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303326464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790946495.285506:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146beee4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303326592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790946495.285564:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946495.285610:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff914688abc900 going to sleep for 11 seconds 00000100:00100000:0.0:1790946495.285695:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303326592 00000100:00100000:0.0:1790946495.285703:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303326592 00000100:00100000:0.0:1790946495.285757:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1790946495.285765:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+17:5831:x1877943303326592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790946495.286141:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+17:5831:x1877943303326592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 376us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946495.286150:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1790946495.286256:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146beee4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303326592:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1790946495.294621:0:11228:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1790946495.297262:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1790946495.297320:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790946495.297335:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146a032b400/0x16e41aef93271d62 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271d69 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946495.297351:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9146a032b400/0x16e41aef93271d62 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271d69 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790946495.297366:0:5831:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790946495.297383:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9146be38b800 from 7 10000000:01000000:3.0:1790946495.297387:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790946495.297440:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146a032a000/0x16e41aef93271d70 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946495.297450:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9146a032a000/0x16e41aef93271d70 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946495.297463:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9146a032a000/0x16e41aef93271d70 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946495.297494:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146beee4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303326720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790946495.297577:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946495.297631:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff914688abc900 going to sleep for 11 seconds 00000100:00100000:0.0:1790946495.297813:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303326720 00000100:00100000:0.0:1790946495.297824:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303326720 00000100:00100000:0.0:1790946495.297981:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1790946495.297994:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+17:5831:x1877943303326720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790946495.298012:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946495.298036:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9146c20caa00/0x16e41aef93271d77 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x16e41aef93271d70 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946495.298068:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9146c20caa00/0x16e41aef93271d77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x16e41aef93271d70 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946495.298090:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9146c20caa00/0x16e41aef93271d77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93271d70 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946495.298101:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146c20caa00, rc 0) 00000100:00100000:0.0:1790946495.298162:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+18:5831:x1877943303326720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946495.298170:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1790946495.299105:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146beee4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303326720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790946495.299137:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9146a032a000/0x16e41aef93271d70 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271d77 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946495.299150:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9146a032a000/0x16e41aef93271d70 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93271d77 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946495.299258:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee95f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303326848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790946495.299311:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946495.299358:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff914684872600 going to sleep for 11 seconds 00000100:00100000:0.0:1790946495.299861:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303326848 00000100:00100000:0.0:1790946495.299870:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303326848 00000100:00100000:0.0:1790946495.299987:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1790946495.299998:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+18:5831:x1877943303326848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790946495.300425:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+18:5831:x1877943303326848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 427us (1111us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946495.300434:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1790946495.300531:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee95f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303326848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790946495.300580:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee95f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303326976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790946495.300630:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946495.311566:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff914684872600 going to sleep for 11 seconds 00000100:00100000:3.0:1790946495.313741:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303326976 00000100:00100000:3.0:1790946495.313758:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303326976 00000100:00100000:3.0:1790946495.313844:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1790946495.313857:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+18:5831:x1877943303326976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790946495.314529:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+18:5831:x1877943303326976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 669us (13893us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946495.314541:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1790946495.315111:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee95f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303326976:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1790946495.317575:0:11229:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1790946495.317924:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1790946495.318050:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790946495.318066:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146a032a000/0x16e41aef93271d70 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271d77 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946495.318090:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9146a032a000/0x16e41aef93271d70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271d77 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790946495.318105:0:5831:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790946495.318116:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9146aa748800 from 7 10000000:01000000:3.0:1790946495.318120:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790946495.318175:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146a032a200/0x16e41aef93271d7e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946495.318185:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9146a032a200/0x16e41aef93271d7e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946495.318235:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9146a032a200/0x16e41aef93271d7e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946495.318266:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146beee5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303327104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790946495.318582:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946495.318628:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff914688abc000 going to sleep for 11 seconds 00000100:00100000:0.0:1790946495.318836:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303327104 00000100:00100000:0.0:1790946495.318846:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303327104 00000100:00100000:0.0:1790946495.318910:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1790946495.318921:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+18:5831:x1877943303327104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790946495.319072:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946495.319101:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9146c20cb200/0x16e41aef93271d85 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x16e41aef93271d7e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946495.319133:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9146c20cb200/0x16e41aef93271d85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x16e41aef93271d7e expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946495.319154:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9146c20cb200/0x16e41aef93271d85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93271d7e expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946495.319165:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146c20cb200, rc 0) 00000100:00100000:0.0:1790946495.319409:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:5831:x1877943303327104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 488us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946495.319417:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1790946495.319529:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146beee5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303327104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790946495.319548:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9146a032a200/0x16e41aef93271d7e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271d85 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946495.319560:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9146a032a200/0x16e41aef93271d7e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93271d85 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946495.319633:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146beee5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303327232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790946495.319664:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946495.319740:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff914688abc000 going to sleep for 11 seconds 00000100:00100000:0.0:1790946495.319778:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303327232 00000100:00100000:0.0:1790946495.319784:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303327232 00000100:00100000:0.0:1790946495.319851:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1790946495.319860:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:5831:x1877943303327232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790946495.320232:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:5831:x1877943303327232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 341us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946495.320241:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1790946495.320340:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146beee5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303327232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790946495.320378:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee95f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303327360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790946495.320426:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946495.320542:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff914684872600 going to sleep for 11 seconds 00000100:00100000:3.0:1790946495.320574:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303327360 00000100:00100000:3.0:1790946495.320579:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303327360 00000100:00100000:3.0:1790946495.320603:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1790946495.320610:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468494e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:5831:x1877943303327360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790946495.320778:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468494e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:5831:x1877943303327360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 168us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946495.320791:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1790946495.320918:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee95f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303327360:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790946495.321923:0:11230:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1790946495.322138:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1790946495.322163:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790946495.322174:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146a032a200/0x16e41aef93271d7e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271d85 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946495.322188:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9146a032a200/0x16e41aef93271d7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271d85 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946495.797118:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946496.830622:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946497.249797:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946497.249859:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946497.249889:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946497.249920:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286513536 00000100:00100000:1.0:1790946497.249929:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286513536 00000100:00100000:1.0:1790946497.249969:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 247 00000100:00100000:1.0:1790946497.249990:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468494c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:2361:x1877943286513536:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790946497.250055:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468494c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:2361:x1877943286513536:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 67us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946497.250062:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 247 00000100:00100000:1.0:1790946497.250119:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286513664 00000100:00100000:1.0:1790946497.250137:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286513664 00000100:00100000:1.0:1790946497.250173:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286513792 00000100:00100000:1.0:1790946497.250177:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286513792 00000100:00100000:1.0:1790946497.250197:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 93 00000100:00100000:1.0:1790946497.250249:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2361:x1877943286513664:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790946497.250283:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2361:x1877943286513664:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 36us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946497.250289:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 93 00000100:00100000:1.0:1790946497.250304:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 94 00000100:00100000:1.0:1790946497.250309:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+5:2361:x1877943286513792:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790946497.250332:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+5:2361:x1877943286513792:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 23us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946497.250338:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 94 00000100:00080000:0.0:1790946497.250592:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790946497.521309:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914685634380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877943303327616:0@lo:400:kworker.0 00000100:00100000:2.0:1790946497.521350:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914685636300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303327872:0@lo:400:kworker.0 00000100:00100000:1.0:1790946497.521420:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914685634700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3302:1877943303327488:0@lo:400:kworker.0 00000100:00100000:0.0:1790946497.534231:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946497.535006:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946497.535099:0:6808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303327872 00000100:00100000:2.0:1790946497.535112:0:6808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303327872 00000100:00100000:2.0:1790946497.535198:0:6808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790946497.535230:0:6808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146befb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1877943303327872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946497.535488:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914685637100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1877943303327744:0@lo:400:kworker.0 00000100:00100000:1.0:1790946497.535697:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946497.535786:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946497.535810:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303327488 00000100:00100000:1.0:1790946497.535815:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303327488 00000100:00100000:1.0:1790946497.535847:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1790946497.535854:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468494c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3302:x1877943303327488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946497.535913:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468494c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3302:x1877943303327488:12345-0@lo:400:kworker.0 Request processed in 59us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946497.535920:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1790946497.535982:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914685634700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3302:1877943303327488:0@lo:400:kworker.0 00000100:00100000:1.0:1790946497.536005:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b6318700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1877943303328000:0@lo:400:kworker.0 00000100:00100000:1.0:1790946497.536031:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946497.536076:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790946497.536084:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b6319c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303328128:0@lo:400:kworker.0 00000100:00100000:1.0:1790946497.536111:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946497.536137:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303328128 00000100:00100000:1.0:1790946497.536141:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303328128 00000100:00100000:1.0:1790946497.536171:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790946497.536177:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303328128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946497.537967:0:6808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146befb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1877943303327872:12345-0@lo:400:kworker.0 Request processed in 2730us (2953us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946497.537983:0:6808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:2.0:1790946497.538081:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff914685636300 x1877943303327872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790946513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946497.538100:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914685636300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303327872:0@lo:400:kworker.0 00000100:00100000:1.0:1790946497.538194:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303328128:12345-0@lo:400:kworker.0 Request processed in 2014us (2079us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946497.538230:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1790946497.538340:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146b6319c00 x1877943303328128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790946513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946497.538351:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b6319c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303328128:0@lo:400:kworker.0 00000100:00100000:0.0:1790946497.538428:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303327616 00000100:00100000:0.0:1790946497.538439:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303327616 00000100:00100000:0.0:1790946497.538495:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303327744 00000100:00100000:0.0:1790946497.538499:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303327744 00000100:00100000:0.0:1790946497.538521:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303328000 00000100:00100000:0.0:1790946497.538524:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303328000 00000100:00100000:0.0:1790946497.538544:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1790946497.538556:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146875b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877943303327616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946497.538697:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1790946497.538707:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1877943303327744:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1790946497.539654:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790946497.539666:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790946497.539670:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790946497.543456:0:6803:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1790946497.543484:0:6803:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1790946497.546328:0:5835:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1790946497.546361:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1790946497.546385:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877943303328000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946497.552302:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877943303328000:12345-0@lo:400:kworker.0 Request processed in 5914us (16254us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946497.552321:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1790946497.552390:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1877943303327744:12345-0@lo:400:kworker.0 Request processed in 13683us (16691us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946497.554670:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146875b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877943303327616:12345-0@lo:400:kworker.0 Request processed in 16108us (20442us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946497.554720:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914685637100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1877943303327744:0@lo:400:kworker.0 00000100:00100000:1.0:1790946497.554795:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b6318700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1877943303328000:0@lo:400:kworker.0 00000100:00100000:1.0:1790946497.554823:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914685634380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877943303327616:0@lo:400:kworker.0 00000100:00100000:2.0:1790946497.555512:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1790946497.556090:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00010000:3.0:1790946497.840433:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946498.037294:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790946498.037324:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303328256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790946498.037422:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946498.037499:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303328256 00000100:00100000:1.0:1790946498.037508:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303328256 00000100:00100000:1.0:1790946498.037560:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790946498.037570:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1877943303328256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790946498.037624:0:6678:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790946498.037673:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1877943303328256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946498.037681:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1790946498.037732:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146bee97b80 x1877943303328256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790946514 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946498.037754:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303328256:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1790946498.532717:0:11371:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1790946498.864493:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946499.890918:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946500.080726:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790946500.080747:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303328384:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790946500.080810:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946500.080968:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303328384 00000100:00100000:1.0:1790946500.080977:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303328384 00000100:00100000:1.0:1790946500.081031:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790946500.081040:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146befb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303328384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790946500.081095:0:6678:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790946500.081141:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146befb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303328384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946500.081148:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1790946500.081413:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790946500.081447:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146bee97b80 x1877943303328384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790946516 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946500.081469:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303328384:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790946500.913929:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946501.939841:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790946502.053533:0:11470:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 09:08:20 (1790946500) === 00000100:00100000:2.0:1790946502.353287:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946502.353333:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946502.353422:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286513920 00000100:00100000:1.0:1790946502.353433:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286513920 00000100:00100000:1.0:1790946502.353499:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:1.0:1790946502.353510:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146befb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2363:x1877943286513920:12345-192.168.203.13@tcp:41:mkdir.0 00000004:00000024:1.0:1790946502.353551:0:5835:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1790946502.353656:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146befb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2363:x1877943286513920:12345-192.168.203.13@tcp:41:mkdir.0 Request processed in 148us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946502.353663:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:3.0:1790946502.353838:0:5843:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286514048 00000100:00100000:3.0:1790946502.353843:0:5843:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286514048 00000100:00100000:3.0:1790946502.353879:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:3.0:1790946502.353887:0:5843:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146befb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:9685:x1877943286514048:12345-192.168.203.13@tcp:700:mkdir.0 00000100:00100000:3.0:1790946502.353930:0:5843:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146befb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:9685:x1877943286514048:12345-192.168.203.13@tcp:700:mkdir.0 Request processed in 43us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946502.353936:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00080000:2.0:1790946502.354053:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790946502.357079:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946502.357185:0:11315:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286514304 00000100:00100000:1.0:1790946502.357195:0:11315:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286514304 00000100:00100000:1.0:1790946502.357308:0:11315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00100000:1.0:1790946502.357319:0:11315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146befb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:9685:x1877943286514304:12345-192.168.203.13@tcp:36:mkdir.0 00010000:00010000:1.0:1790946502.357370:0:11315:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790946502.357431:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914680031200/0x16e41aef93271c6d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cba9 expref: 6 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.357453:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff914686750d00) 00010000:00010000:1.0:1790946502.357464:0:11315:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790946502.357775:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f000/0x16e41aef93271d8c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.357789:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f000/0x16e41aef93271d8c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.357799:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f000/0x16e41aef93271d8c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.357825:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef93271d93 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.357844:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef93271d93 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.357851:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef93271d93 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790946502.358977:0:11315:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1790946502.358991:0:11315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f000/0x16e41aef93271d8c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.358999:0:11315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f000/0x16e41aef93271d8c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.359006:0:11315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f000/0x16e41aef93271d8c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.359011:0:11315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180f000 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:1.0:1790946502.359015:0:11315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f000/0x16e41aef93271d8c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.359022:0:11315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f000/0x16e41aef93271d8c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.359046:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91469e29d200) 00010000:00010000:1.0:1790946502.359050:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790946502.359053:0:11315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f000/0x16e41aef93271d8c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.359058:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f000/0x16e41aef93271d8c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790946502.359085:0:11315:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000010e70cdc reply state 00000000952c3635 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef93271d93 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946502.359093:0:11315:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790946502.359193:0:11315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146befb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+7:9685:x1877943286514304:12345-192.168.203.13@tcp:36:mkdir.0 Request processed in 1874us (2120us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1790946502.359237:0:11315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 15 00010000:00010000:2.0:1790946502.366282:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef93271d93 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.366311:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef93271d93 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.366319:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef93271d93 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.366325:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180fc00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:2.0:1790946502.366330:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef93271d93 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.366338:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef93271d93 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.366361:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff91469e29d100) 00010000:00010000:2.0:1790946502.366364:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790946502.366369:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef93271d93 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.366375:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef93271d93 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946502.367549:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946502.367632:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286514432 00000100:00100000:0.0:1790946502.367642:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286514432 00000100:00100000:0.0:1790946502.367701:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 249 00000100:00100000:0.0:1790946502.367712:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468494e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:2363:x1877943286514432:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1790946502.367795:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468494e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:2363:x1877943286514432:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 85us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946502.367804:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 249 00000100:00100000:3.0:1790946502.368381:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946502.368459:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286514560 00000100:00100000:0.0:1790946502.368467:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286514560 00000100:00100000:0.0:1790946502.368524:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 98 00000100:00100000:0.0:1790946502.368531:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beee6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+5:2363:x1877943286514560:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1790946502.368610:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beee6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+5:2363:x1877943286514560:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 78us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946502.368618:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 98 00000100:00080000:2.0:1790946502.368683:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790946502.380967:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946502.385050:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286514688 00000100:00100000:0.0:1790946502.385071:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286514688 00000100:00100000:0.0:1790946502.385274:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:0.0:1790946502.385288:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beee5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:9686:x1877943286514688:12345-192.168.203.13@tcp:101:chmod.0 00010000:00010000:0.0:1790946502.385319:0:6803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946502.385351:0:6803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cb600/0x16e41aef93271d9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cc2e expref: -99 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946502.385438:0:6803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cac00/0x16e41aef93271da1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946502.385474:0:6803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cac00/0x16e41aef93271da1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946502.385487:0:6803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cac00/0x16e41aef93271da1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790946502.385531:0:6803:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790946502.385535:0:6803:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790946502.385579:0:6803:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cac00/0x16e41aef93271da1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946502.385608:0:6803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cb600/0x16e41aef93271d9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc2e expref: 8 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946502.385633:0:6803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cac00/0x16e41aef93271da1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc2e expref: 7 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946502.385643:0:6803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff914686750100) 00010000:00010000:0.0:1790946502.385646:0:6803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790946502.385650:0:6803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146c20cac00, rc 0) 00000100:00100000:0.0:1790946502.386966:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beee5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+7:9686:x1877943286514688:12345-192.168.203.13@tcp:101:chmod.0 Request processed in 1670us (6004us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946502.389496:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946502.391863:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286514944 00000100:00100000:2.0:1790946502.391884:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286514944 00000100:00100000:0.0:1790946502.394601:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:0.0:1790946502.394680:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:0.0:1790946502.394703:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beee4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+7:9686:x1877943286514944:12345-192.168.203.13@tcp:36:chmod.0 00010000:00010000:0.0:1790946502.395193:0:6803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790946502.395274:0:6803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cac00/0x16e41aef93271da1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc2e expref: 7 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946502.395315:0:6803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff914686750100) 00010000:00010000:0.0:1790946502.395330:0:6803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790946502.395375:0:6803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20ca200/0x16e41aef93271da8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946502.395392:0:6803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20ca200/0x16e41aef93271da8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946502.395402:0:6803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20ca200/0x16e41aef93271da8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790946502.395825:0:6803:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000144741af reply state 000000003208cc64 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20ca200/0x16e41aef93271da8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946502.395839:0:6803:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1790946502.395849:0:6803:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1790946502.397138:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beee4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+8:9686:x1877943286514944:12345-192.168.203.13@tcp:36:chmod.0 Request processed in 2437us (7646us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1790946502.397163:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 17 00010000:00010000:2.0:1790946502.403457:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20ca200/0x16e41aef93271da8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.403479:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20ca200/0x16e41aef93271da8 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.403489:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20ca200/0x16e41aef93271da8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.403495:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146c20ca200 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:2.0:1790946502.403501:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20ca200/0x16e41aef93271da8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.403509:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20ca200/0x16e41aef93271da8 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.403528:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff914686750200) 00010000:00010000:2.0:1790946502.403531:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790946502.403536:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20ca200/0x16e41aef93271da8 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.403542:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20ca200/0x16e41aef93271da8 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946502.418742:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946502.419357:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286515072 00000100:00100000:1.0:1790946502.419372:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286515072 00000100:00100000:1.0:1790946502.419456:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:1.0:1790946502.419468:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beee6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+7:9687:x1877943286515072:12345-192.168.203.13@tcp:101:chown.0 00010000:00010000:1.0:1790946502.419492:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946502.419516:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f000/0x16e41aef93271daf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cc35 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.419586:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93271db6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.419600:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93271db6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.419612:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93271db6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790946502.419651:0:5835:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790946502.419655:0:5835:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790946502.419694:0:5835:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93271db6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.419740:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f000/0x16e41aef93271daf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc35 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.419760:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93271db6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc35 expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.419768:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91469e29d200) 00010000:00010000:1.0:1790946502.419771:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790946502.419774:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b180e600, rc 0) 00000100:00100000:1.0:1790946502.419841:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beee6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+8:9687:x1877943286515072:12345-192.168.203.13@tcp:101:chown.0 Request processed in 375us (1115us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946502.419848:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:3.0:1790946502.422818:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946502.423107:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286515200 00000100:00100000:0.0:1790946502.423120:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286515200 00000100:00100000:0.0:1790946502.423192:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:0.0:1790946502.423242:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beee7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+8:9687:x1877943286515200:12345-192.168.203.13@tcp:101:chown.0 00010000:00010000:0.0:1790946502.423269:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946502.423369:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cac00/0x16e41aef93271dbd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cc3c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946502.423455:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cb600/0x16e41aef93271dc4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946502.423489:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cb600/0x16e41aef93271dc4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946502.423502:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cb600/0x16e41aef93271dc4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946502.423520:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cbc00/0x16e41aef93271dcb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946502.423528:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cbc00/0x16e41aef93271dcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946502.423535:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cbc00/0x16e41aef93271dcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946502.423667:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20ca200/0x16e41aef93271dd2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946502.423677:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20ca200/0x16e41aef93271dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946502.423685:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20ca200/0x16e41aef93271dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790946502.423723:0:5836:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790946502.423728:0:5836:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790946502.423757:0:5836:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20ca200/0x16e41aef93271dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946502.423770:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cb600/0x16e41aef93271dc4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946502.423788:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cb600/0x16e41aef93271dc4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946502.423795:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cb600/0x16e41aef93271dc4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946502.423802:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146c20cb600 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:0.0:1790946502.423807:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cb600/0x16e41aef93271dc4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946502.423816:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cb600/0x16e41aef93271dc4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946502.423829:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91469e29d200) 00010000:00010000:0.0:1790946502.423833:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790946502.423929:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cb600/0x16e41aef93271dc4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946502.423936:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cb600/0x16e41aef93271dc4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946502.423955:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cbc00/0x16e41aef93271dcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946502.423962:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cbc00/0x16e41aef93271dcb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946502.423973:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cbc00/0x16e41aef93271dcb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946502.423979:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146c20cbc00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:0.0:1790946502.423989:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cbc00/0x16e41aef93271dcb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946502.423996:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cbc00/0x16e41aef93271dcb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946502.424006:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff914686750100) 00010000:00010000:0.0:1790946502.424009:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790946502.424012:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cbc00/0x16e41aef93271dcb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946502.424018:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cbc00/0x16e41aef93271dcb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946502.424075:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cac00/0x16e41aef93271dbd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc3c expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946502.424092:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20ca200/0x16e41aef93271dd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc3c expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946502.424100:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff914686750b00) 00010000:00010000:0.0:1790946502.424102:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790946502.424104:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146c20ca200, rc 0) 00000100:00100000:0.0:1790946502.424194:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beee7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+9:9687:x1877943286515200:12345-192.168.203.13@tcp:101:chown.0 Request processed in 992us (1385us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946502.424236:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:3.0:1790946502.428527:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946502.428689:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286515456 00000100:00100000:1.0:1790946502.428746:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286515456 00000100:00100000:1.0:1790946502.428818:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:1.0:1790946502.428827:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beee5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+9:9687:x1877943286515456:12345-192.168.203.13@tcp:36:chown.0 00010000:00010000:1.0:1790946502.428893:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790946502.428924:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20ca200/0x16e41aef93271dd2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc3c expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.428958:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff914686750b00) 00010000:00010000:1.0:1790946502.428971:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790946502.429002:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93271dd9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.429018:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93271dd9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.429136:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93271dd9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790946502.457902:0:5857:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:1.0:1790946502.457997:0:5834:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000544be77a reply state 0000000008f4565c transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93271dd9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946502.458013:0:5834:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1790946502.458039:0:5834:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:1.0:1790946502.458469:0:5834:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1790946502.458499:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beee5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+7:9687:x1877943286515456:12345-192.168.203.13@tcp:36:chown.0 Request processed in 29665us (29978us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1790946502.458511:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 20 00010000:00010000:0.0:1790946502.458588:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93271dd9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946502.458599:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93271dd9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946502.458628:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93271dd9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946502.458635:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180f800 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:0.0:1790946502.458641:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93271dd9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946502.458649:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93271dd9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946502.458670:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91469e29d900) 00010000:00010000:0.0:1790946502.458674:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790946502.458679:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93271dd9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946502.458687:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93271dd9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946502.477729:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946502.477787:0:11315:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286515584 00000100:00100000:2.0:1790946502.477801:0:11315:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286515584 00000100:00100000:2.0:1790946502.477955:0:11315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:2.0:1790946502.477967:0:11315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beee6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:9688:x1877943286515584:12345-192.168.203.13@tcp:101:touch.500 00010000:00010000:2.0:1790946502.478005:0:11315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946502.478048:0:11315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee200/0x16e41aef93271de0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cc43 expref: -99 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790946502.481315:0:11315:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3196us 00010000:00010000:2.0:1790946502.490845:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef93271de7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.490875:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef93271de7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.490886:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef93271de7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.490901:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef93271dee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.490907:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef93271dee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.490912:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef93271dee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.491342:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef93271df5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.491353:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef93271df5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.491361:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef93271df5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790946502.491392:0:11315:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790946502.491395:0:11315:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790946502.491440:0:11315:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef93271df5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.491452:0:11315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef93271de7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.491459:0:11315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef93271de7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.491466:0:11315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef93271de7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.491472:0:11315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aee400 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:2.0:1790946502.491477:0:11315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef93271de7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.491485:0:11315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef93271de7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.491497:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91469e29d200) 00010000:00010000:2.0:1790946502.491500:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790946502.491505:0:11315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef93271de7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.491511:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef93271de7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.491521:0:11315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef93271dee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.491535:0:11315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef93271dee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.491541:0:11315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef93271dee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.491546:0:11315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aeec00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:2.0:1790946502.491549:0:11315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef93271dee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.491555:0:11315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef93271dee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.491562:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9146a0a5ee00) 00010000:00010000:2.0:1790946502.491565:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790946502.491568:0:11315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef93271dee lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.491575:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef93271dee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.491616:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee200/0x16e41aef93271de0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc43 expref: 8 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.491629:0:11315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef93271df5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc43 expref: 7 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.491637:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9146a0a5e800) 00010000:00010000:2.0:1790946502.491639:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1790946502.491645:0:11315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914688aee000, rc 0) 00000100:00100000:2.0:1790946502.491738:0:11315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beee6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+7:9688:x1877943286515584:12345-192.168.203.13@tcp:101:touch.500 Request processed in 13772us (14019us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946502.491749:0:11315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:2.0:1790946502.496479:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946502.497905:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286515840 00000100:00100000:1.0:1790946502.497919:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286515840 00000100:00100000:1.0:1790946502.497989:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00100000:1.0:1790946502.497999:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b68aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+7:9688:x1877943286515840:12345-192.168.203.13@tcp:101:touch.500 00010000:00010000:1.0:1790946502.498021:0:6803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946502.498058:0:6803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f000/0x16e41aef93271dfc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cc4a expref: -99 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.498372:0:6803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fe00/0x16e41aef93271e03 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.498388:0:6803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fe00/0x16e41aef93271e03 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.498399:0:6803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fe00/0x16e41aef93271e03 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.498428:0:6803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e200/0x16e41aef93271e0a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.498435:0:6803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e200/0x16e41aef93271e0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.498442:0:6803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e200/0x16e41aef93271e0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790946502.499236:0:6803:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1790946502.499538:0:6803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93271e11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.499552:0:6803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93271e11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.499562:0:6803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93271e11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.499603:0:6803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fe00/0x16e41aef93271e03 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.499612:0:6803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fe00/0x16e41aef93271e03 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.499620:0:6803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fe00/0x16e41aef93271e03 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.499626:0:6803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180fe00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:1.0:1790946502.499631:0:6803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fe00/0x16e41aef93271e03 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.499651:0:6803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fe00/0x16e41aef93271e03 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.499665:0:6803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9146a0a5e800) 00010000:00010000:1.0:1790946502.499668:0:6803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790946502.499674:0:6803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fe00/0x16e41aef93271e03 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.499680:0:6803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fe00/0x16e41aef93271e03 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790946502.499695:0:6803:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000005c7e3c9c reply state 00000000362100b2 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e200/0x16e41aef93271e0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946502.499706:0:6803:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790946502.499747:0:6803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f000/0x16e41aef93271dfc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc4a expref: 10 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.499762:0:6803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93271e11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc4a expref: 9 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.499768:0:6803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91469e29db00) 00010000:00010000:1.0:1790946502.499770:0:6803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790946502.499773:0:6803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b180f600, rc 0) 00000100:00100000:1.0:1790946502.499845:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b68aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+10:9688:x1877943286515840:12345-192.168.203.13@tcp:101:touch.500 Request processed in 1846us (3375us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1790946502.499854:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00100000:2.0:1790946502.505250:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946502.505291:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286516096 00000100:00100000:2.0:1790946502.505299:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286516096 00000100:00100000:2.0:1790946502.505355:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 23 00000100:00100000:2.0:1790946502.505366:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b68a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+10:9688:x1877943286516096:12345-192.168.203.13@tcp:36:touch.500 00010000:00010000:2.0:1790946502.505419:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790946502.505449:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93271e11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc4a expref: 10 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.505469:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91469e29db00) 00010000:00010000:2.0:1790946502.505483:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790946502.505523:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeea00/0x16e41aef93271e1f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.505536:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeea00/0x16e41aef93271e1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.505547:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeea00/0x16e41aef93271e1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790946502.505777:0:5834:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000003bfd9cd reply state 00000000854832e3 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeea00/0x16e41aef93271e1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946502.505786:0:5834:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790946502.505884:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b68a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+11:9688:x1877943286516096:12345-192.168.203.13@tcp:36:touch.500 Request processed in 519us (643us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1790946502.505892:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 23 00010000:00010000:3.0:1790946502.506415:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e200/0x16e41aef93271e0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946502.506425:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e200/0x16e41aef93271e0a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946502.506433:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e200/0x16e41aef93271e0a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946502.506448:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180e200 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946502.506453:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e200/0x16e41aef93271e0a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946502.506461:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e200/0x16e41aef93271e0a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946502.506476:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x596de974 (ffff91469e29de00) 00010000:00010000:3.0:1790946502.506480:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946502.506484:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e200/0x16e41aef93271e0a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946502.506491:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e200/0x16e41aef93271e0a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946502.511047:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946502.512347:0:11315:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286516224 00000100:00100000:2.0:1790946502.512359:0:11315:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286516224 00000100:00100000:2.0:1790946502.512469:0:11315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00100000:2.0:1790946502.512480:0:11315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+10:9688:x1877943286516224:12345-192.168.203.13@tcp:101:touch.500 00010000:00010000:2.0:1790946502.512506:0:11315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946502.512527:0:11315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93271e26 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cc51 expref: -99 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.512585:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93271e26 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc51 expref: 11 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.512598:0:11315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93271e26 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc51 expref: 11 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.512617:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9146a0a5ec00) 00010000:00010000:2.0:1790946502.512620:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790946502.512623:0:11315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914688aee600, rc 0) 00000100:00100000:2.0:1790946502.512682:0:11315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+11:9688:x1877943286516224:12345-192.168.203.13@tcp:101:touch.500 Request processed in 204us (1662us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946502.512690:0:11315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 24 00010000:00010000:3.0:1790946502.513350:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeea00/0x16e41aef93271e1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946502.513362:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeea00/0x16e41aef93271e1f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946502.513369:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeea00/0x16e41aef93271e1f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946502.513376:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aeea00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946502.513380:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeea00/0x16e41aef93271e1f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946502.513387:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeea00/0x16e41aef93271e1f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946502.513417:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9146a0a5ec00) 00010000:00010000:3.0:1790946502.513420:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946502.513424:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeea00/0x16e41aef93271e1f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946502.513431:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeea00/0x16e41aef93271e1f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946502.522090:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946502.522391:0:6808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286516352 00000100:00100000:0.0:1790946502.522401:0:6808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286516352 00000100:00100000:0.0:1790946502.522448:0:6808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:0.0:1790946502.522454:0:6808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beee5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2360:x1877943286516352:12345-192.168.203.13@tcp:8:touch.500 00010000:00080000:0.0:1790946502.522484:0:6808:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 7eed1f4b-bd5b-4a70-8045-59db065b3dfc@192.168.203.13@tcp t0 exp 0000000000000000 cur 287 last 0 00000020:00000080:0.0:1790946502.522518:0:6808:0:(genops.c:1384:class_connect()) connect: client 7eed1f4b-bd5b-4a70-8045-59db065b3dfc, cookie 0x16e41aef93271e2d 00002000:00100000:0.0:1790946502.522530:0:6808:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7eed1f4b-bd5b-4a70-8045-59db065b3dfc/ffff914684987800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b03 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790946502.522553:0:6808:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type b7, return b7 00002000:00080000:0.0:1790946502.522783:0:6808:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1790946502.522812:0:6808:0:(import.c:65:import_set_state_nolock()) ffff914684985000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790946502.522893:0:6808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beee5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2360:x1877943286516352:12345-192.168.203.13@tcp:8:touch.500 Request processed in 437us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946502.522902:0:6808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:3.0:1790946502.537910:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946502.538015:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286516480 00000100:00100000:1.0:1790946502.538048:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286516480 00000100:00100000:1.0:1790946502.538136:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:1.0:1790946502.538147:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beee4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:0:x1877943286516480:12345-192.168.203.13@tcp:2:touch.500 00000100:00080000:2.0:1790946502.538490:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:1.0:1790946502.620521:0:7645:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7eed1f4b-bd5b-4a70-8045-59db065b3dfc 00000001:00080000:1.0:1790946502.620539:0:7645:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:0.0:1790946502.620819:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beee4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+5:0:x1877943286516480:12345-192.168.203.13@tcp:2:touch.500 Request processed in 82669us (82913us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1790946502.620830:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:0.0:1790946502.633390:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946502.634073:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286516736 00000100:00100000:1.0:1790946502.634084:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286516736 00000100:00100000:1.0:1790946502.634142:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 2 00000100:00100000:1.0:1790946502.634152:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146875b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+10:9688:x1877943286516736:12345-192.168.203.13@tcp:35:touch.500 00000100:00100000:2.0:1790946502.634751:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146875b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+11:9688:x1877943286516736:12345-192.168.203.13@tcp:35:touch.500 Request processed in 596us (1365us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1790946502.634759:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 2 00000100:00100000:0.0:1790946502.643748:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146beee4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1877943303328768:0@lo:400:kworker.0 00000100:00100000:0.0:1790946502.643817:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946502.643887:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790946502.643893:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146beee5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303328896:0@lo:400:kworker.0 00000100:00100000:0.0:1790946502.643917:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946502.643950:0:6808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303328896 00000100:00100000:0.0:1790946502.643957:0:6808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303328896 00000100:00100000:0.0:1790946502.644010:0:6808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1790946502.644020:0:6808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146875b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303328896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946502.644082:0:6808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146875b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303328896:12345-0@lo:400:kworker.0 Request processed in 64us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946502.644089:0:6808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1790946502.644110:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790946502.644139:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146beee5500 x1877943303328896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790946518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946502.644152:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146beee5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303328896:0@lo:400:kworker.0 00000100:00100000:1.0:1790946502.644294:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146beee7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3302:1877943303328512:0@lo:400:kworker.0 00000100:00100000:1.0:1790946502.644329:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946502.644364:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146beee4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1877943303329024:0@lo:400:kworker.0 00000100:00100000:1.0:1790946502.644387:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946502.644408:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1790946502.644415:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146beee4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877943303328640:0@lo:400:kworker.0 00000100:00100000:1.0:1790946502.644437:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946502.644453:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146beee6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303329152:0@lo:400:kworker.0 00000100:00100000:1.0:1790946502.644474:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946502.644501:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303328768 00000100:00100000:1.0:1790946502.644505:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303328768 00000100:00100000:1.0:1790946502.644534:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303329024 00000100:00100000:1.0:1790946502.644537:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303329024 00000100:00100000:1.0:1790946502.644552:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303328640 00000100:00100000:1.0:1790946502.644555:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303328640 00000100:00100000:1.0:1790946502.644568:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1790946502.644574:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146875b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1877943303328768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946502.644630:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146875b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1877943303328768:12345-0@lo:400:kworker.0 Request processed in 55us (811us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946502.644637:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1790946502.644650:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1790946502.644656:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877943303329024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946502.644684:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877943303329024:12345-0@lo:400:kworker.0 Request processed in 29us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946502.644690:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1790946502.644700:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1790946502.644705:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b6318700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877943303328640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946502.644730:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b6318700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877943303328640:12345-0@lo:400:kworker.0 Request processed in 25us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946502.644735:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1790946502.644756:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303329152 00000100:00100000:1.0:1790946502.644760:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303329152 00000100:00100000:1.0:1790946502.644782:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1790946502.644788:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b6319c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303329152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946502.644834:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b6319c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303329152:12345-0@lo:400:kworker.0 Request processed in 46us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946502.644840:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1790946502.644875:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146beee4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877943303328640:0@lo:400:kworker.0 00010000:00080000:1.0:1790946502.644886:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146beee6680 x1877943303329152/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790946518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946502.644895:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146beee6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303329152:0@lo:400:kworker.0 00000100:00100000:1.0:1790946502.644913:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146beee4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1877943303329024:0@lo:400:kworker.0 00000100:00100000:0.0:1790946502.645094:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303328512 00000100:00100000:0.0:1790946502.645099:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303328512 00000100:00100000:0.0:1790946502.645135:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1790946502.645149:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468494e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3302:x1877943303328512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946502.645249:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468494e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3302:x1877943303328512:12345-0@lo:400:kworker.0 Request processed in 100us (919us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946502.645256:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00080000:0.0:1790946502.645303:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790946502.645307:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790946502.645329:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146beee4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1877943303328768:0@lo:400:kworker.0 00000100:00100000:1.0:1790946502.645524:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146beee7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3302:1877943303328512:0@lo:400:kworker.0 00000100:00100000:3.0:1790946502.682459:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946502.683065:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286516864 00000100:00100000:1.0:1790946502.683081:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286516864 00000100:00100000:3.0:1790946502.683615:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 25 00000100:00100000:3.0:1790946502.683633:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beee7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+11:9689:x1877943286516864:12345-192.168.203.13@tcp:101:rm.0 00010000:00010000:3.0:1790946502.683665:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946502.683871:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032be00/0x16e41aef93271e34 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cc58 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946502.684094:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef93271e3b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946502.684112:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef93271e3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946502.684125:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef93271e3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790946502.684170:0:5834:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790946502.684175:0:5834:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790946502.684313:0:5834:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef93271e3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946502.684510:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032be00/0x16e41aef93271e34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc58 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946502.684533:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef93271e3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc58 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946502.684542:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9146a0a5e800) 00010000:00010000:3.0:1790946502.684545:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790946502.684549:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146a032a400, rc 0) 00000100:00100000:3.0:1790946502.684723:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beee7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+12:9689:x1877943286516864:12345-192.168.203.13@tcp:101:rm.0 Request processed in 1096us (2277us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946502.684731:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 25 00000100:00100000:2.0:1790946502.696719:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946502.696982:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286517120 00000100:00100000:1.0:1790946502.696997:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286517120 00000100:00100000:1.0:1790946502.697084:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 26 00000100:00100000:1.0:1790946502.697095:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b68aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+12:9689:x1877943286517120:12345-192.168.203.13@tcp:101:rm.0 00010000:00010000:1.0:1790946502.697123:0:6803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946502.697150:0:6803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f000/0x16e41aef93271e42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cc5f expref: -99 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790946502.697302:0:6803:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1790946502.697743:0:6803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f000/0x16e41aef93271e42 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc5f expref: 14 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.697760:0:6803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91469e29d200) 00010000:00010000:1.0:1790946502.697764:0:6803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790946502.697771:0:6803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f000/0x16e41aef93271e42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc5f expref: 14 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.697994:0:6803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b180f000, rc 0) 00000100:00100000:1.0:1790946502.698134:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b68aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+13:9689:x1877943286517120:12345-192.168.203.13@tcp:101:rm.0 Request processed in 1039us (1429us total) trans 4294967303 rc 301/301 00000100:00100000:1.0:1790946502.698142:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 26 00000100:00100000:0.0:1790946502.711133:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946502.711626:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286517248 00000100:00100000:3.0:1790946502.711642:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286517248 00000100:00100000:3.0:1790946502.711719:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 3 00000100:00100000:3.0:1790946502.711731:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146875b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+13:9689:x1877943286517248:12345-192.168.203.13@tcp:37:rm.0 00000100:00100000:2.0:1790946502.732785:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146875b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+13:9689:x1877943286517248:12345-192.168.203.13@tcp:37:rm.0 Request processed in 21039us (21649us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946502.732802:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 3 00000100:00100000:2.0:1790946502.738187:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946502.741305:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286517504 00000100:00100000:0.0:1790946502.741327:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286517504 00000100:00100000:0.0:1790946502.741417:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:0.0:1790946502.741429:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b2653c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+13:9689:x1877943286517504:12345-192.168.203.13@tcp:35:rm.0 00000100:00100000:0.0:1790946502.741769:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b2653c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+14:9689:x1877943286517504:12345-192.168.203.13@tcp:35:rm.0 Request processed in 341us (3594us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1790946502.741777:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:0.0:1790946502.747282:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946502.747485:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286517760 00000100:00100000:3.0:1790946502.747501:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286517760 00000100:00100000:3.0:1790946502.747575:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 27 00000100:00100000:3.0:1790946502.747586:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146875b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+14:9689:x1877943286517760:12345-192.168.203.13@tcp:101:rm.0 00010000:00010000:3.0:1790946502.747619:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946502.747645:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032be00/0x16e41aef93271e50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cc66 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946502.748144:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef93271e57 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946502.748186:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef93271e57 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946502.748227:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef93271e57 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790946502.748243:0:5835:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1790946502.748454:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032be00/0x16e41aef93271e50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc66 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946502.748478:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef93271e57 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc66 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946502.748487:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9146a0a5e800) 00010000:00010000:3.0:1790946502.748491:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790946502.748495:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146a032ae00, rc 0) 00000100:00100000:3.0:1790946502.748581:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146875b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+16:9689:x1877943286517760:12345-192.168.203.13@tcp:101:rm.0 Request processed in 996us (1312us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1790946502.748591:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 27 00000100:00100000:3.0:1790946502.752687:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946502.753480:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286517888 00000100:00100000:0.0:1790946502.753496:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286517888 00000100:00100000:0.0:1790946502.753576:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 28 00000100:00100000:0.0:1790946502.753588:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beee4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+16:9689:x1877943286517888:12345-192.168.203.13@tcp:41:rm.0 00000004:00000024:0.0:1790946502.753668:0:5834:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1790946502.753832:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beee4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+16:9689:x1877943286517888:12345-192.168.203.13@tcp:41:rm.0 Request processed in 245us (1160us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946502.754080:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 28 00000100:00100000:2.0:1790946502.756521:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946502.756605:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286518016 00000100:00100000:1.0:1790946502.756638:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286518016 00000100:00100000:1.0:1790946502.756719:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 29 00000100:00100000:1.0:1790946502.756730:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b68ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+16:9689:x1877943286518016:12345-192.168.203.13@tcp:101:rm.0 00010000:00010000:1.0:1790946502.756761:0:6803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946502.756787:0:6803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fe00/0x16e41aef93271e65 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cc6d expref: -99 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.756991:0:6803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f000/0x16e41aef93271e6c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.757011:0:6803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f000/0x16e41aef93271e6c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.757039:0:6803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f000/0x16e41aef93271e6c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.757059:0:6803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93271e73 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.757066:0:6803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93271e73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.757083:0:6803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93271e73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.757251:0:6803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e200/0x16e41aef93271e7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.757261:0:6803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e200/0x16e41aef93271e7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.757269:0:6803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e200/0x16e41aef93271e7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790946502.757311:0:6803:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:1.0:1790946502.757316:0:6803:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790946502.757340:0:6803:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e200/0x16e41aef93271e7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.757354:0:6803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e200/0x16e41aef93271e7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.757363:0:6803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f000/0x16e41aef93271e6c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.757371:0:6803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f000/0x16e41aef93271e6c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.757379:0:6803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f000/0x16e41aef93271e6c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.757385:0:6803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180f000 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:1.0:1790946502.757390:0:6803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f000/0x16e41aef93271e6c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.757399:0:6803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f000/0x16e41aef93271e6c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.757413:0:6803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9146a0a5e800) 00010000:00010000:1.0:1790946502.757416:0:6803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790946502.757421:0:6803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f000/0x16e41aef93271e6c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.757427:0:6803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f000/0x16e41aef93271e6c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.757453:0:6803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93271e73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.757459:0:6803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93271e73 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.757465:0:6803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93271e73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.757471:0:6803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180f600 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:1.0:1790946502.757474:0:6803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93271e73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.757480:0:6803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93271e73 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.757487:0:6803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x596de974 (ffff91469e29da00) 00010000:00010000:1.0:1790946502.757490:0:6803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790946502.757493:0:6803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93271e73 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.757499:0:6803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93271e73 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.757536:0:6803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fe00/0x16e41aef93271e65 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc6d expref: 18 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.757552:0:6803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e200/0x16e41aef93271e7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc6d expref: 17 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946502.757572:0:6803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9146a0a5ec00) 00010000:00010000:1.0:1790946502.757574:0:6803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790946502.757577:0:6803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b180e200, rc 0) 00000100:00100000:1.0:1790946502.762010:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b68ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+17:9689:x1877943286518016:12345-192.168.203.13@tcp:101:rm.0 Request processed in 5259us (5479us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946502.762036:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 29 00000100:00100000:1.0:1790946502.769113:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946502.769354:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286518272 00000100:00100000:3.0:1790946502.769367:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286518272 00000100:00100000:3.0:1790946502.769429:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 30 00000100:00100000:3.0:1790946502.769440:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914685634380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+17:9689:x1877943286518272:12345-192.168.203.13@tcp:36:rm.0 00010000:00010000:3.0:1790946502.769511:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1790946502.769548:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e200/0x16e41aef93271e7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc6d expref: 17 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946502.769599:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93271e26 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc51 expref: 16 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946502.769612:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9146a0a5ec00) 00010000:00010000:3.0:1790946502.769628:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef93271e3b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc58 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946502.769637:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9146a0a5e800) 00010000:00010000:3.0:1790946502.769641:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790946502.769665:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032be00/0x16e41aef93271e81 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946502.769681:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032be00/0x16e41aef93271e81 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946502.769690:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032be00/0x16e41aef93271e81 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946502.769706:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93271e88 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946502.769713:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93271e88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946502.769719:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93271e88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946502.769846:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff914680031200/0x16e41aef93271e8f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946502.769863:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914680031200/0x16e41aef93271e8f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946502.769870:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914680031200/0x16e41aef93271e8f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790946502.770729:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1790946502.770741:0:5835:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 287842539911ns, next at 288842537311ns, rc = 0 00010000:00010000:3.0:1790946502.770810:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff914680031e00/0x16e41aef93271e96 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946502.770825:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914680031e00/0x16e41aef93271e96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946502.770834:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914680031e00/0x16e41aef93271e96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946502.770843:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff914680031e00/0x16e41aef93271e96 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946502.770850:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff914680031e00/0x16e41aef93271e96 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946502.770857:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff914680031e00/0x16e41aef93271e96 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946502.770877:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790946502.770900:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff914680031200/0x16e41aef93271e8f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946502.770905:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff914680031200/0x16e41aef93271e8f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946502.770922:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff914680031200/0x16e41aef93271e8f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946502.770928:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914680031200 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946502.770933:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914680031200/0x16e41aef93271e8f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946502.770942:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914680031200/0x16e41aef93271e8f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946502.770953:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9146836df700) 00010000:00010000:3.0:1790946502.770957:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1790946502.770961:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff914680031200/0x16e41aef93271e8f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946502.770968:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914680031200/0x16e41aef93271e8f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946502.770986:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032be00/0x16e41aef93271e81 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946502.770992:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032be00/0x16e41aef93271e81 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946502.770997:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032be00/0x16e41aef93271e81 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946502.771003:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146a032be00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946502.771006:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032be00/0x16e41aef93271e81 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946502.771021:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032be00/0x16e41aef93271e81 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946502.771040:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9146a0a5e800) 00010000:00010000:3.0:1790946502.771043:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946502.771046:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032be00/0x16e41aef93271e81 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946502.771052:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032be00/0x16e41aef93271e81 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790946502.771063:0:5835:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e4ec637c reply state 00000000d1db48ca transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93271e88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946502.771074:0:5835:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790946502.771189:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914685634380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+16:9689:x1877943286518272:12345-192.168.203.13@tcp:36:rm.0 Request processed in 1746us (2086us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1790946502.771197:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 30 00010000:00010000:2.0:1790946502.771408:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946502.771416:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff914680031e00/0x16e41aef93271e96 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.771424:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914680031e00 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:2.0:1790946502.771428:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914680031e00/0x16e41aef93271e96 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.771435:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914680031e00/0x16e41aef93271e96 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.771445:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9146836df700) 00010000:00010000:2.0:1790946502.771447:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1790946502.771451:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff914680031e00/0x16e41aef93271e96 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.771456:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914680031e00/0x16e41aef93271e96 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.771473:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946502.771475:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946502.771477:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946502.776504:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946502.777119:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286518528 00000100:00100000:0.0:1790946502.777133:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286518528 00000100:00100000:0.0:1790946502.777245:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:0.0:1790946502.777257:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b68aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+16:9689:x1877943286518528:12345-192.168.203.13@tcp:35:rm.0 00000100:00100000:0.0:1790946502.777568:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b68aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+17:9689:x1877943286518528:12345-192.168.203.13@tcp:35:rm.0 Request processed in 312us (1079us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1790946502.777577:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 5 00010000:00010000:3.0:1790946502.780970:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93271e88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946502.780994:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93271e88 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946502.781003:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93271e88 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946502.781010:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146a032bc00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946502.781033:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93271e88 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946502.781071:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93271e88 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946502.781093:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x596de974 (ffff9146836dfe00) 00010000:00010000:3.0:1790946502.781096:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946502.781102:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93271e88 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946502.781109:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93271e88 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946502.782685:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946502.782913:0:11315:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286518784 00000100:00100000:2.0:1790946502.782927:0:11315:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286518784 00000100:00100000:2.0:1790946502.782988:0:11315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 31 00000100:00100000:2.0:1790946502.783014:0:11315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914685637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+16:9689:x1877943286518784:12345-192.168.203.13@tcp:36:rm.0 00010000:00010000:2.0:1790946502.783115:0:11315:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1790946502.783145:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef93271e57 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc66 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.783167:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef93271df5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc43 expref: 15 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.783177:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9146a0a5e800) 00010000:00010000:2.0:1790946502.783192:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93271db6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc35 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.783234:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91469e29d200) 00010000:00010000:2.0:1790946502.783242:0:11315:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790946502.783269:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef93271e9d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.783285:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef93271e9d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.783296:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef93271e9d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.783308:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef400/0x16e41aef93271ea4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.783314:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef400/0x16e41aef93271ea4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.783321:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef400/0x16e41aef93271ea4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.783654:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef93271eab lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.783663:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef93271eab lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.783671:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef93271eab lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790946502.784348:0:11315:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1790946502.784371:0:11315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef93271eab lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.784379:0:11315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef93271eab lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.784387:0:11315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef93271eab lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.784393:0:11315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aef200 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:2.0:1790946502.784398:0:11315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef93271eab lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.784407:0:11315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef93271eab lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.784420:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9146a0a5e200) 00010000:00010000:2.0:1790946502.784423:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1790946502.784427:0:11315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef93271eab lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.784446:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef93271eab lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.784468:0:11315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef93271e9d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.784474:0:11315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef93271e9d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.784480:0:11315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef93271e9d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.784485:0:11315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aefc00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:2.0:1790946502.784488:0:11315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef93271e9d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.784494:0:11315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef93271e9d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.784501:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9146a0a5ed00) 00010000:00010000:2.0:1790946502.784503:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790946502.784506:0:11315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef93271e9d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.784512:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef93271e9d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790946502.784524:0:11315:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000001e4df5e3 reply state 00000000a6a30a46 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef400/0x16e41aef93271ea4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946502.784533:0:11315:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790946502.784647:0:11315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914685637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+15:9689:x1877943286518784:12345-192.168.203.13@tcp:36:rm.0 Request processed in 1633us (1971us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1790946502.784657:0:11315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 31 00010000:00010000:3.0:1790946502.787551:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef400/0x16e41aef93271ea4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946502.787573:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef400/0x16e41aef93271ea4 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946502.787583:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef400/0x16e41aef93271ea4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946502.787589:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aef400 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946502.787594:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef400/0x16e41aef93271ea4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946502.787603:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef400/0x16e41aef93271ea4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946502.787620:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9146a0a5ee00) 00010000:00010000:3.0:1790946502.787624:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946502.787629:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef400/0x16e41aef93271ea4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946502.787654:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef400/0x16e41aef93271ea4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946502.962951:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946503.152805:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914685636300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303329280:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790946503.152910:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946503.153126:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303329280 00000100:00100000:2.0:1790946503.153136:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303329280 00000100:00100000:2.0:1790946503.153218:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790946503.153229:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146875b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303329280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790946503.153258:0:6678:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790946503.155475:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146875b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303329280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2234us (2552us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946503.155491:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1790946503.157657:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff914685636300 x1877943303329280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790946519 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946503.157758:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914685636300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303329280:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790946503.988353:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946505.011382:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946505.206495:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790946505.206518:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914685634700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303329408:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790946505.206584:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946505.206641:0:6676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303329408 00000100:00100000:1.0:1790946505.206651:0:6676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303329408 00000100:00100000:1.0:1790946505.206709:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790946505.206718:0:6676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914685636300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303329408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790946505.206755:0:6676:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790946505.206796:0:6676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914685636300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303329408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946505.206803:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1790946505.206825:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790946505.206852:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff914685634700 x1877943303329408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790946521 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946505.206870:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914685634700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303329408:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1790946506.034012:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946507.056506:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790946507.414057:0:11622:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:1.0:1790946507.494935:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946507.495000:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946507.495064:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286518912 00000100:00100000:2.0:1790946507.495073:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286518912 00000100:00100000:2.0:1790946507.495124:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 251 00000100:00100000:2.0:1790946507.495133:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468494f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:2361:x1877943286518912:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790946507.495220:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468494f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:2361:x1877943286518912:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 67us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946507.495228:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 251 00000100:00100000:3.0:1790946507.495544:0:6808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286519168 00000100:00100000:3.0:1790946507.495549:0:6808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286519168 00000100:00100000:3.0:1790946507.495598:0:6808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 58 00000100:00100000:3.0:1790946507.495605:0:6808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914685634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+5:2361:x1877943286519168:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790946507.495637:0:6808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914685634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+5:2361:x1877943286519168:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 33us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946507.495643:0:6808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 58 00000100:00080000:2.0:1790946507.495822:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790946507.498002:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946507.498047:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946507.498241:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286519040 00000100:00100000:0.0:1790946507.498251:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286519040 00000100:00100000:0.0:1790946507.498304:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286519296 00000100:00100000:0.0:1790946507.498307:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286519296 00000100:00100000:0.0:1790946507.498332:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 102 00000100:00100000:0.0:1790946507.498341:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146becb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+14:2362:x1877943286519040:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1790946507.498412:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146becb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+14:2362:x1877943286519040:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 72us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946507.498419:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 102 00000100:00100000:0.0:1790946507.498437:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 103 00000100:00100000:0.0:1790946507.498443:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146becb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+5:2362:x1877943286519296:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1790946507.498471:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146becb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+5:2362:x1877943286519296:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 27us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946507.498477:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 103 00000100:00080000:1.0:1790946507.498873:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790946507.764580:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146becb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3302:1877943303329536:0@lo:400:kworker.0 00000100:00100000:1.0:1790946507.764650:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946507.764693:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146becb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1877943303330048:0@lo:400:kworker.0 00000100:00100000:1.0:1790946507.764718:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946507.764742:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1790946507.764748:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146becb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877943303329664:0@lo:400:kworker.0 00000100:00100000:1.0:1790946507.764769:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946507.764784:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146becb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303330176:0@lo:400:kworker.0 00000100:00100000:1.0:1790946507.764807:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946507.764831:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146becb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1877943303329792:0@lo:400:kworker.0 00000100:00100000:1.0:1790946507.764854:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946507.764869:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790946507.764874:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146becb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303329920:0@lo:400:kworker.0 00000100:00100000:1.0:1790946507.764894:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946507.764921:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303330048 00000100:00100000:1.0:1790946507.764929:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303330048 00000100:00100000:1.0:1790946507.764973:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303329664 00000100:00100000:1.0:1790946507.764977:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303329664 00000100:00100000:1.0:1790946507.765008:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303329792 00000100:00100000:1.0:1790946507.765011:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303329792 00000100:00100000:1.0:1790946507.765028:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1790946507.765035:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146becb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877943303330048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946507.765084:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146becb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877943303330048:12345-0@lo:400:kworker.0 Request processed in 49us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946507.765100:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1790946507.765116:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1790946507.765121:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146becb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877943303329664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946507.765150:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146becb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877943303329664:12345-0@lo:400:kworker.0 Request processed in 29us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946507.765157:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1790946507.765168:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1790946507.765174:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146becb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1877943303329792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946507.765227:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146becb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1877943303329792:12345-0@lo:400:kworker.0 Request processed in 52us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946507.765232:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1790946507.765251:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303330176 00000100:00100000:1.0:1790946507.765254:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303330176 00000100:00100000:1.0:1790946507.765278:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303329920 00000100:00100000:1.0:1790946507.765281:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303329920 00000100:00100000:1.0:1790946507.765296:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1790946507.765302:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146becb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303330176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946507.765333:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146becb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303330176:12345-0@lo:400:kworker.0 Request processed in 31us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946507.765338:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1790946507.765349:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1790946507.765354:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146becb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303329920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946507.765393:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146becb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303329920:12345-0@lo:400:kworker.0 Request processed in 39us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946507.765399:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1790946507.765420:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790946507.765424:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790946507.765426:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1790946507.765455:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146becb4700 x1877943303329920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790946523 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946507.765468:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146becb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303329920:0@lo:400:kworker.0 00000100:00100000:1.0:1790946507.765478:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146becb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1877943303329792:0@lo:400:kworker.0 00000100:00100000:1.0:1790946507.765508:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146becb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877943303329664:0@lo:400:kworker.0 00010000:00080000:1.0:1790946507.765517:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146becb4380 x1877943303330176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790946523 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946507.765525:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146becb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303330176:0@lo:400:kworker.0 00000100:00100000:1.0:1790946507.765534:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146becb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1877943303330048:0@lo:400:kworker.0 00000100:00100000:2.0:1790946507.769845:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303329536 00000100:00100000:2.0:1790946507.769858:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303329536 00000100:00100000:2.0:1790946507.769905:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1790946507.769915:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468494d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3302:x1877943303329536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946507.770016:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468494d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3302:x1877943303329536:12345-0@lo:400:kworker.0 Request processed in 104us (5365us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946507.770037:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1790946507.770116:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146becb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3302:1877943303329536:0@lo:400:kworker.0 00000001:00080000:2.0:1790946507.908651:0:5857:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000001:00080000:2.0:1790946507.908676:0:5857:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:2.0:1790946507.908688:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:2.0:1790946507.908967:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146beee4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303330304:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1790946507.909040:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946507.909350:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303330304 00000100:00100000:3.0:1790946507.909358:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303330304 00000100:00100000:3.0:1790946507.909402:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790946507.909410:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bdcca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303330304:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1790946507.909435:0:6674:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:3.0:1790946507.909468:0:6674:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6abfacc6, atime: 0x6abfacc6, ctime: 0x6abfacc6, blocks: 0x1 00010000:00010000:3.0:1790946507.909476:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac3db502/0x16e41aef93271eb2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946507.909492:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=292s v=(0 0) 00010000:00010000:3.0:1790946507.909497:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790946507.909503:0:6674:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac3db502/0x16e41aef93271eb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946507.909520:0:6674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac3db502/0x16e41aef93271eb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946507.909542:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac3db502/0x16e41aef93271eb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946507.909550:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac3db502/0x16e41aef93271eb2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946507.909565:0:6674:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1790946507.910164:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bdcca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3300:x1877943303330304:12345-0@lo:6:osp-syn-1-0.0 Request processed in 752us (1122us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1790946507.910172:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1790946507.910384:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946507.910392:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac3db502/0x16e41aef93271eb2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946507.910403:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914680031200 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:2.0:1790946507.910408:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac3db502/0x16e41aef93271eb2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946507.910417:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac3db502/0x16e41aef93271eb2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946507.910435:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac3db502/0x16e41aef93271eb2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946507.910441:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac3db502/0x16e41aef93271eb2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946507.910460:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946507.910462:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946507.910469:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1790946507.910505:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9146beee4a80/2, rc 0, transno 4294967300 00000100:00100000:2.0:1790946507.910510:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146beee4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303330304:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1790946508.083816:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946508.277844:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146becb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303330432:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790946508.277911:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946508.278184:0:6676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303330432 00000100:00100000:0.0:1790946508.278193:0:6676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303330432 00000100:00100000:0.0:1790946508.278332:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790946508.278341:0:6676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146becb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1877943303330432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790946508.278484:0:6676:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790946508.278539:0:6676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146becb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1877943303330432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 199us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946508.278546:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790946508.278666:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146becb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303330432:0@lo:13:osp-pre-1-0.0 00000020:00000080:3.0:1790946508.659432:0:11671:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff63972b50 20000000:00000080:3.0:1790946508.659448:0:11671:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9146bee10000 uarg=0000000000000000 20000000:01000000:3.0:1790946508.659484:0:11671:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1790946508.659490:0:11671:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1790946508.659495:0:11671:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1790946508.661170:0:11672:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1790946508.666738:0:11671:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1790946508.672056:0:11671:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1790946508.672105:0:11671:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1790946508.672149:0:11671:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1790946508.672163:0:11671:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1790946508.672182:0:11671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff914688aee600/0x16e41aef93271eb9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946508.672866:0:11671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9146a032a800/0x16e41aef93271d54 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc20 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946508.672877:0:11671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9146b180fa00/0x16e41aef93271d5b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc27 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946508.672885:0:11671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9146b180ee00/0x16e41aef93271d69 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93271d62 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946508.672892:0:11671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9146c20caa00/0x16e41aef93271d77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93271d70 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946508.672898:0:11671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9146c20cb200/0x16e41aef93271d85 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93271d7e expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946508.672906:0:11671:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff914688aee600/0x16e41aef93271eb9 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946508.672944:0:11671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9146c20cb200/0x16e41aef93271d85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x16e41aef93271d7e expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946508.672968:0:11671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9146c20cb200/0x16e41aef93271d85 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x16e41aef93271d7e expref: 18 pid: 5828 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946508.672992:0:11671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bdcc9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11671:1877943303330560:0@lo:104: 00000100:00100000:2.0:1790946508.673054:0:11671:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790946508.673112:0:11671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9146c20caa00/0x16e41aef93271d77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x16e41aef93271d70 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946508.673120:0:11671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9146c20caa00/0x16e41aef93271d77 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x16e41aef93271d70 expref: 18 pid: 5828 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946508.673128:0:11671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bdcc8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11671:1877943303330688:0@lo:104: 00000100:00100000:2.0:1790946508.673145:0:11671:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790946508.673249:0:11671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9146b180ee00/0x16e41aef93271d69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x16e41aef93271d62 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946508.673257:0:11671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9146b180ee00/0x16e41aef93271d69 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x16e41aef93271d62 expref: 18 pid: 5827 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946508.673265:0:11671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cfca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11671:1877943303330816:0@lo:104: 00000100:00100000:2.0:1790946508.673284:0:11671:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790946508.682626:0:11671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9146b180fa00/0x16e41aef93271d5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc27 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946508.682649:0:11671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9146b180fa00/0x16e41aef93271d5b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc27 expref: 12 pid: 5829 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946508.682663:0:11671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cff800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11671:1877943303330944:192.168.203.13@tcp:104: 00010000:00010000:2.0:1790946508.682890:0:11671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9146a032a800/0x16e41aef93271d54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc20 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946508.682900:0:11671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9146a032a800/0x16e41aef93271d54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc20 expref: 12 pid: 5828 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946508.682909:0:11671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cff100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11671:1877943303331072:192.168.203.13@tcp:104: 00000100:00100000:2.0:1790946508.682939:0:11671:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146becd7240 going to sleep for 11 seconds 00000100:00100000:2.0:1790946508.685070:0:6689:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1790946508.685097:0:6689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303330560 00000100:00100000:2.0:1790946508.685117:0:6689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303330560 00000100:00100000:2.0:1790946508.685177:0:6689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303330688 00000100:00100000:2.0:1790946508.685181:0:6689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303330688 00000100:00100000:2.0:1790946508.685193:0:6689:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303330816 00000100:00100000:2.0:1790946508.685195:0:6689:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303330816 00000100:00100000:2.0:1790946508.685238:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790946508.685247:0:6689:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bdcc8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+5:11671:x1877943303330560:12345-0@lo:104: 00010000:00010000:2.0:1790946508.685264:0:6689:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9146a032a200/0x16e41aef93271d7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93271d85 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946508.685505:0:8516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790946508.685515:0:8516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bdcc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+5:11671:x1877943303330688:12345-0@lo:104: 00010000:00010000:3.0:1790946508.685524:0:8516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9146a032a000/0x16e41aef93271d70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93271d77 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946508.685584:0:8516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790946508.685590:0:8516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bdcc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+5:11671:x1877943303330688:12345-0@lo:104: Request processed in 78us (12444us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946508.685597:0:8516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790946508.685632:0:8516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790946508.685638:0:8516:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be857450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+4:11671:x1877943303330816:12345-0@lo:104: 00010000:00010000:3.0:1790946508.685645:0:8516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9146a032b400/0x16e41aef93271d62 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93271d69 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946508.685694:0:8516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1790946508.685700:0:8516:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be857450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+4:11671:x1877943303330816:12345-0@lo:104: Request processed in 62us (12415us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946508.685706:0:8516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1790946508.685723:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790946508.685729:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9146a032a000/0x16e41aef93271d70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93271d77 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946508.685736:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146a032a000 already unused, calling callback (ffffffffc1d96c20) 10000000:00010000:3.0:1790946508.685740:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9146a032a000/0x16e41aef93271d70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x16e41aef93271d77 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946508.685749:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9146a032a000/0x16e41aef93271d70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x16e41aef93271d77 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790946508.685756:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9146a032a000/0x16e41aef93271d70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x16e41aef93271d77 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790946508.685761:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790946508.685796:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9146a032a000/0x16e41aef93271d70 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271d77 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946508.685802:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790946508.685821:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9146a032a000/0x16e41aef93271d70 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271d77 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946508.685840:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9146a032a000/0x16e41aef93271d70 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271d77 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946508.685852:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790946508.685856:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9146a032b400/0x16e41aef93271d62 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93271d69 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946508.685862:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146a032b400 already unused, calling callback (ffffffffc1d96c20) 10000000:00010000:3.0:1790946508.685865:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9146a032b400/0x16e41aef93271d62 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x16e41aef93271d69 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946508.685872:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9146a032b400/0x16e41aef93271d62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x16e41aef93271d69 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790946508.685877:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9146a032b400/0x16e41aef93271d62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x16e41aef93271d69 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790946508.685883:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790946508.685897:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9146a032b400/0x16e41aef93271d62 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271d69 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946508.685902:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790946508.685909:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9146a032b400/0x16e41aef93271d62 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271d69 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946508.685915:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9146a032b400/0x16e41aef93271d62 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271d69 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946508.685923:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946508.685931:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946508.685933:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946508.685940:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946508.685961:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146beee6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3302:1877943303331200:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790946508.686010:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946508.686046:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790946508.686053:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146beee4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3302:1877943303331328:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790946508.686075:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946508.686116:0:5821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303331200 00000100:00100000:3.0:1790946508.686121:0:5821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303331200 00010000:00010000:3.0:1790946508.686142:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9146c20caa00/0x16e41aef93271d77 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef93271d70 expref: 19 pid: 5828 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946508.686169:0:5821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303331328 00000100:00100000:3.0:1790946508.686172:0:5821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303331328 00010000:00010000:3.0:1790946508.686183:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9146b180ee00/0x16e41aef93271d69 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef93271d62 expref: 20 pid: 5827 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946508.686194:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790946508.686220:0:5821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beee5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+20:3302:x1877943303331200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790946508.686232:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790946508.686237:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9146c20caa00/0x16e41aef93271d77 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef93271d70 expref: 20 pid: 5828 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946508.686246:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9146c20caa00/0x16e41aef93271d77 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x16e41aef93271d70 expref: 20 pid: 5828 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946508.686262:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790946508.686288:0:5821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beee5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+20:3302:x1877943303331200:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946508.686301:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:2.0:1790946508.686788:0:6689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790946508.686795:0:6689:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bdcc8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+3:11671:x1877943303330560:12345-0@lo:104: Request processed in 1548us (13741us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946508.686802:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790946508.686867:0:11671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bdcc9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11671:1877943303330560:0@lo:104: 00010000:00010000:2.0:1790946508.686879:0:11671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9146c20caa00/0x16e41aef93271d77 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x16e41aef93271d70 expref: 20 pid: 5828 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946508.686891:0:11671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bdcc8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11671:1877943303330688:0@lo:104: 00000100:00100000:2.0:1790946508.686910:0:11671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cfca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11671:1877943303330816:0@lo:104: 00000100:00100000:2.0:1790946508.686948:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146beee6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3302:1877943303331200:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790946508.686975:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946508.686980:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9146a032a200/0x16e41aef93271d7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93271d85 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946508.686999:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146a032a200 already unused, calling callback (ffffffffc1d96c20) 10000000:00010000:2.0:1790946508.687003:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9146a032a200/0x16e41aef93271d7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x16e41aef93271d85 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946508.687011:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9146a032a200/0x16e41aef93271d7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x16e41aef93271d85 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790946508.687018:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9146a032a200/0x16e41aef93271d7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x16e41aef93271d85 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790946508.687024:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790946508.687053:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9146a032a200/0x16e41aef93271d7e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271d85 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946508.687059:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790946508.687078:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9146a032a200/0x16e41aef93271d7e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271d85 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946508.687085:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9146a032a200/0x16e41aef93271d7e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93271d85 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946508.687098:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946508.687099:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946508.687101:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946508.687188:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790946508.687198:0:5821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be075c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+18:3302:x1877943303331328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790946508.687228:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790946508.687233:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9146b180ee00/0x16e41aef93271d69 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef93271d62 expref: 18 pid: 5827 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946508.687252:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9146b180ee00/0x16e41aef93271d69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x16e41aef93271d62 expref: 18 pid: 5827 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946508.687263:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9146b180ee00/0x16e41aef93271d69 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x16e41aef93271d62 expref: 18 pid: 5827 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946508.687273:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790946508.687563:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3300:1877943303331456:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790946508.687601:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946508.687661:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146beee4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3302:1877943303331328:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790946508.688013:0:5821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be075c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+17:3302:x1877943303331328:12345-0@lo:103:ldlm_bl.0 Request processed in 114us (1233us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946508.688023:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790946508.688041:0:5821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303331456 00000100:00100000:3.0:1790946508.688046:0:5821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303331456 00010000:00010000:3.0:1790946508.688067:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9146c20cb200/0x16e41aef93271d85 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef93271d7e expref: 17 pid: 5828 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946508.688084:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790946508.688090:0:5821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914685714850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+17:3300:x1877943303331456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790946508.688099:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790946508.688103:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9146c20cb200/0x16e41aef93271d85 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef93271d7e expref: 17 pid: 5828 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946508.690099:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9146c20cb200/0x16e41aef93271d85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x16e41aef93271d7e expref: 17 pid: 5828 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946508.690129:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9146c20cb200/0x16e41aef93271d85 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x16e41aef93271d7e expref: 17 pid: 5828 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946508.690148:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790946508.696521:0:5817:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00000100:00100000:3.0:1790946508.696661:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946508.696822:0:5821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914685714850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+16:3300:x1877943303331456:12345-0@lo:103:ldlm_bl.0 Request processed in 8728us (9217us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946508.696834:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790946508.699029:0:5818:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00000100:00100000:3.0:1790946508.700538:0:11671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cff800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11671:1877943303330944:192.168.203.13@tcp:104: 00000100:00100000:3.0:1790946508.701410:0:11671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cff100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11671:1877943303331072:192.168.203.13@tcp:104: 00010000:00010000:3.0:1790946508.701446:0:11671:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff914688aee600/0x16e41aef93271eb9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946508.702292:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3300:1877943303331456:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790946508.702805:0:5821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286519424 00000100:00100000:2.0:1790946508.702813:0:5821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286519424 00010000:00010000:2.0:1790946508.702847:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9146b180fa00/0x16e41aef93271d5b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc27 expref: 13 pid: 5829 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946508.703196:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 33 00000100:00100000:2.0:1790946508.703234:0:5821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be075f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:2364:x1877943286519424:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790946508.703251:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790946508.703257:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9146b180fa00/0x16e41aef93271d5b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc27 expref: 13 pid: 5829 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946508.703270:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9146b180fa00/0x16e41aef93271d5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc27 expref: 13 pid: 5829 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946508.703287:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9146b180fa00/0x16e41aef93271d5b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc27 expref: 13 pid: 5829 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946508.703302:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790946508.703859:0:5821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be075f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec4ece38-7293-498c-8428-4d215a1f0fd0+12:2364:x1877943286519424:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 626us (7201us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946508.703867:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 33 00000100:00100000:0.0:1790946508.716133:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946508.716197:0:5821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286519552 00000100:00100000:2.0:1790946508.716243:0:5821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286519552 00010000:00010000:2.0:1790946508.716278:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9146a032a800/0x16e41aef93271d54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc20 expref: 12 pid: 5828 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946508.716306:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 34 00000100:00100000:2.0:1790946508.716323:0:5821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146875b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec4ece38-7293-498c-8428-4d215a1f0fd0+12:2363:x1877943286519552:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790946508.716337:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790946508.716342:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9146a032a800/0x16e41aef93271d54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc20 expref: 12 pid: 5828 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946508.716353:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9146a032a800/0x16e41aef93271d54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc20 expref: 12 pid: 5828 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946508.716369:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9146a032a800/0x16e41aef93271d54 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc20 expref: 12 pid: 5828 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946508.716385:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff914688aee600/0x16e41aef93271eb9 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946508.716393:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff914688aee600/0x16e41aef93271eb9 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946508.716407:0:5821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff914688aee600/0x16e41aef93271eb9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946508.716414:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff914688aee600/0x16e41aef93271eb9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946508.716422:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff914688aee600/0x16e41aef93271eb9 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946508.716438:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff914688aee600/0x16e41aef93271eb9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946508.716444:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aee600 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:2.0:1790946508.716448:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff914688aee600/0x16e41aef93271eb9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946508.716456:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff914688aee600/0x16e41aef93271eb9 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946508.716470:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff914688aee600/0x16e41aef93271eb9 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946508.716479:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790946508.716541:0:5821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146875b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec4ece38-7293-498c-8428-4d215a1f0fd0+11:2363:x1877943286519552:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 218us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946508.716549:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 34 00010000:00010000:3.0:1790946508.716851:0:11671:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff914688aee600/0x16e41aef93271eb9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946508.716861:0:11671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff914688aee600/0x16e41aef93271eb9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946508.716867:0:11671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff914688aee600/0x16e41aef93271eb9 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946509.104744:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1790946509.808285:0:5831:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790946509.808292:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9145853b6000 from 7 10000000:01000000:2.0:1790946509.808297:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790946509.808351:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff914688aeea00/0x16e41aef93271ec0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946509.808369:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff914688aeea00/0x16e41aef93271ec0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946509.808380:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff914688aeea00/0x16e41aef93271ec0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946509.808407:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cfc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303331584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790946509.808491:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946509.808586:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146becd7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790946509.827054:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303331584 00000100:00100000:1.0:1790946509.827073:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303331584 00000100:00100000:1.0:1790946509.827145:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1790946509.827155:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468494dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+16:5831:x1877943303331584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790946509.827172:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946509.827194:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9146b180fe00/0x16e41aef93271ec7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x16e41aef93271ec0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946509.827264:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9146b180fe00/0x16e41aef93271ec7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x16e41aef93271ec0 expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946509.827276:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9146b180fe00/0x16e41aef93271ec7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93271ec0 expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946509.827285:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b180fe00, rc 0) 00000100:00100000:1.0:1790946509.827373:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468494dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+17:5831:x1877943303331584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 220us (18882us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946509.827390:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1790946509.828526:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cfc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303331584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790946509.828549:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff914688aeea00/0x16e41aef93271ec0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271ec7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946509.828572:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff914688aeea00/0x16e41aef93271ec0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93271ec7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946509.828661:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be075c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303331712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790946509.828702:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946509.828735:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146879a93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790946509.828902:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303331712 00000100:00100000:0.0:1790946509.828908:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303331712 00000100:00100000:0.0:1790946509.828945:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1790946509.828954:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468494cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+17:5831:x1877943303331712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790946509.829235:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468494cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+17:5831:x1877943303331712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 282us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946509.829243:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1790946509.829371:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be075c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303331712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790946509.829411:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be075c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303331840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790946509.829451:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946509.829475:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146879a93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790946509.829810:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303331840 00000100:00100000:0.0:1790946509.829816:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303331840 00000100:00100000:0.0:1790946509.829851:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1790946509.829859:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468494c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+17:5831:x1877943303331840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790946509.830023:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468494c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+17:5831:x1877943303331840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 164us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946509.830030:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1790946509.830603:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be075c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303331840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790946509.831374:0:11684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be075c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:11684:1877943303331968:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790946509.831566:0:11684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946509.831658:0:11684:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146879a9000 going to sleep for 11 seconds 00000100:00100000:0.0:1790946509.836854:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303331968 00000100:00100000:0.0:1790946509.836869:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303331968 00000100:00100000:0.0:1790946509.837163:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1790946509.837197:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682e30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+17:11684:x1877943303331968:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790946509.837500:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682e30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+17:11684:x1877943303331968:12345-0@lo:502:llog_process_th.0 Request processed in 314us (5933us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946509.837508:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1790946509.837611:0:11684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be075c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:11684:1877943303331968:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790946509.837662:0:11684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790946509.837672:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790946509.837674:0:11684:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790946509.837684:0:11684:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9145853b6000 00000020:00000080:3.0:1790946509.837687:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1790946509.837782:0:11684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be075c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:11684:1877943303332096:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790946509.837825:0:11684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946509.865534:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303332096 00000100:00100000:1.0:1790946509.865550:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303332096 00000100:00100000:0.0:1790946509.865752:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1790946509.865767:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682e30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+17:11684:x1877943303332096:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790946509.866594:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682e30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+17:11684:x1877943303332096:12345-0@lo:502:llog_process_th.0 Request processed in 780us (28717us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946509.866606:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1790946509.867270:0:11684:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146879a9000 going to sleep for 11 seconds 00000100:00100000:0.0:1790946509.868607:0:11684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be075c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:11684:1877943303332096:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790946509.868659:0:11684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790946509.868668:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790946509.868671:0:11684:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1790946509.868675:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1790946509.868746:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1790946509.868768:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790946509.868778:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff914688aeea00/0x16e41aef93271ec0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271ec7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946509.868789:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff914688aeea00/0x16e41aef93271ec0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271ec7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790946509.868800:0:5831:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790946509.868803:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9146be38b800 from 7 10000000:01000000:0.0:1790946509.868806:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790946509.868837:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146c20ca200/0x16e41aef93271ece lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946509.868858:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9146c20ca200/0x16e41aef93271ece lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946509.868867:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9146c20ca200/0x16e41aef93271ece lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946509.868890:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146875b0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303332224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790946509.868970:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946509.869013:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff914690149a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790946509.869031:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303332224 00000100:00100000:0.0:1790946509.869036:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303332224 00000100:00100000:0.0:1790946509.869075:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1790946509.869082:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682e33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+17:5831:x1877943303332224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790946509.869096:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946509.869108:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9146c20caa00/0x16e41aef93271ed5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x16e41aef93271ece expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946509.869128:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9146c20caa00/0x16e41aef93271ed5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x16e41aef93271ece expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946509.869139:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9146c20caa00/0x16e41aef93271ed5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93271ece expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946509.869147:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146c20caa00, rc 0) 00000100:00100000:0.0:1790946509.869182:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682e33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+18:5831:x1877943303332224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946509.869189:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1790946509.869258:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146875b0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303332224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790946509.869270:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9146c20ca200/0x16e41aef93271ece lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271ed5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946509.869290:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9146c20ca200/0x16e41aef93271ece lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93271ed5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946509.869825:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146875b0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303332352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790946509.869860:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946509.869878:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff914690149a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790946509.869899:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303332352 00000100:00100000:0.0:1790946509.869903:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303332352 00000100:00100000:0.0:1790946509.869922:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1790946509.869928:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682e33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+18:5831:x1877943303332352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790946509.872636:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682e33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+18:5831:x1877943303332352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2700us (2769us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946509.872650:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1790946509.873045:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146875b0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303332352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790946509.873101:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146becb7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303332480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790946509.873153:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946509.873195:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146b6328d80 going to sleep for 11 seconds 00000100:00100000:3.0:1790946509.873426:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303332480 00000100:00100000:3.0:1790946509.873434:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303332480 00000100:00100000:3.0:1790946509.873490:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1790946509.873500:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682e33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+18:5831:x1877943303332480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790946509.873692:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682e33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+18:5831:x1877943303332480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 194us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946509.873699:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1790946509.874619:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146becb7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303332480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790946509.876052:0:11688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be075c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:11688:1877943303332608:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790946509.876120:0:11688:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946509.876165:0:11688:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146879a9000 going to sleep for 11 seconds 00000040:00080000:0.0:1790946509.876992:0:11687:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1790946509.878006:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303332608 00000100:00100000:1.0:1790946509.878016:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303332608 00000100:00100000:1.0:1790946509.884314:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1790946509.884337:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682e32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+18:11688:x1877943303332608:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790946509.884633:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682e32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+18:11688:x1877943303332608:12345-0@lo:502:llog_process_th.0 Request processed in 304us (8511us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946509.884641:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1790946509.884889:0:11688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be075c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:11688:1877943303332608:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790946509.884924:0:11688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790946509.884933:0:11688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790946509.884935:0:11688:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790946509.884944:0:11688:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9146be38b800 00000020:00000080:3.0:1790946509.884946:0:11688:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1790946509.885050:0:11688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be075c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:11688:1877943303332736:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790946509.885093:0:11688:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946509.885129:0:11688:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146879a9000 going to sleep for 11 seconds 00000100:00100000:1.0:1790946509.885174:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303332736 00000100:00100000:1.0:1790946509.885182:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303332736 00000100:00100000:1.0:1790946509.885249:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1790946509.885256:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+18:11688:x1877943303332736:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790946509.885397:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+18:11688:x1877943303332736:12345-0@lo:502:llog_process_th.0 Request processed in 141us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946509.885404:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1790946509.886774:0:11688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be075c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:11688:1877943303332736:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790946509.886812:0:11688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790946509.886820:0:11688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790946509.886823:0:11688:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1790946509.886830:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1790946509.887489:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1790946509.887517:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790946509.887529:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146c20ca200/0x16e41aef93271ece lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271ed5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946509.887544:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9146c20ca200/0x16e41aef93271ece lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271ed5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790946509.887558:0:5831:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790946509.887561:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9146aa748800 from 7 10000000:01000000:1.0:1790946509.887565:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790946509.887607:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146b180e200/0x16e41aef93271edc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946509.887616:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9146b180e200/0x16e41aef93271edc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946509.887627:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9146b180e200/0x16e41aef93271edc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946509.887663:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146becb6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303332864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790946509.887731:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946509.887774:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146b6328300 going to sleep for 11 seconds 00000100:00100000:3.0:1790946509.887897:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303332864 00000100:00100000:3.0:1790946509.887904:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303332864 00000100:00100000:3.0:1790946509.887949:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1790946509.887958:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+18:5831:x1877943303332864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790946509.887992:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946509.888005:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff914680031e00/0x16e41aef93271ee3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x16e41aef93271edc expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946509.888031:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff914680031e00/0x16e41aef93271ee3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x16e41aef93271edc expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946509.888041:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff914680031e00/0x16e41aef93271ee3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93271edc expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946509.888050:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914680031e00, rc 0) 00000100:00100000:3.0:1790946509.888091:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:5831:x1877943303332864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946509.888098:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1790946509.894799:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146becb6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303332864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790946509.894837:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9146b180e200/0x16e41aef93271edc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271ee3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946509.894850:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9146b180e200/0x16e41aef93271edc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93271ee3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946509.894933:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146becb6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303332992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790946509.895007:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946509.895043:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146b6328300 going to sleep for 11 seconds 00000100:00100000:3.0:1790946509.896798:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303332992 00000100:00100000:3.0:1790946509.896810:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303332992 00000100:00100000:3.0:1790946509.896867:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1790946509.896877:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:5831:x1877943303332992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790946509.897187:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:5831:x1877943303332992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 310us (2179us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946509.897195:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1790946509.897774:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146becb6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303332992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790946509.897825:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146becb6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303333120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790946509.897877:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946509.897915:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146b6328300 going to sleep for 11 seconds 00000100:00100000:0.0:1790946509.900044:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303333120 00000100:00100000:0.0:1790946509.900057:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303333120 00000100:00100000:0.0:1790946509.900115:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1790946509.900124:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:5831:x1877943303333120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790946509.900366:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:5831:x1877943303333120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 243us (2488us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946509.900374:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1790946509.900491:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146becb6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:5831:1877943303333120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790946509.910354:0:11690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be075c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:11690:1877943303333248:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790946509.910471:0:11690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946509.910522:0:11690:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146b6571600 going to sleep for 11 seconds 00000100:00100000:0.0:1790946509.910634:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303333248 00000100:00100000:0.0:1790946509.910651:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303333248 00000100:00100000:0.0:1790946509.910700:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1790946509.910709:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:11690:x1877943303333248:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790946509.910930:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:11690:x1877943303333248:12345-0@lo:502:llog_process_th.0 Request processed in 221us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946509.910939:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1790946509.911292:0:11690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be075c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:11690:1877943303333248:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790946509.911322:0:11690:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790946509.911331:0:11690:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790946509.911341:0:11690:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790946509.911352:0:11690:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9146aa748800 00000020:00000080:3.0:1790946509.911355:0:11690:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1790946509.911541:0:11690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be075c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:11690:1877943303333376:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790946509.911584:0:11690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946509.911612:0:11690:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146b6571600 going to sleep for 11 seconds 00000100:00100000:1.0:1790946509.912143:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303333376 00000100:00100000:1.0:1790946509.912150:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303333376 00000100:00100000:1.0:1790946509.912195:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1790946509.912227:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:11690:x1877943303333376:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790946509.912422:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:11690:x1877943303333376:12345-0@lo:502:llog_process_th.0 Request processed in 196us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946509.912429:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1790946509.913347:0:11690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be075c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:11690:1877943303333376:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790946509.913449:0:11690:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790946509.913458:0:11690:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790946509.913461:0:11690:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1790946509.913470:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1790946509.913635:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1790946509.913670:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790946509.913680:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146b180e200/0x16e41aef93271edc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271ee3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946509.913692:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9146b180e200/0x16e41aef93271edc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271ee3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946510.128397:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946510.322763:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790946510.322787:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146becb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303333504:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790946510.322855:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946510.323000:0:6676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303333504 00000100:00100000:0.0:1790946510.323009:0:6676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303333504 00000100:00100000:0.0:1790946510.323070:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790946510.323081:0:6676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303333504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790946510.323116:0:6676:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790946510.323167:0:6676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303333504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946510.323174:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:0.0:1790946510.323234:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146becb6a00 x1877943303333504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790946526 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946510.323251:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146becb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303333504:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1790946510.324714:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790946510.688099:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946510.688290:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286519680 00000100:00100000:3.0:1790946510.688311:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286519680 00000100:00100000:3.0:1790946510.688373:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 268 00000100:00100000:3.0:1790946510.688383:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec4ece38-7293-498c-8428-4d215a1f0fd0+11:5602:x1877943286519680:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790946510.688400:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946510.688418:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff914680031200/0x16e41aef93271eea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cc74 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946510.688445:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff914680031200/0x16e41aef93271eea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc74 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946510.688456:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff914680031200/0x16e41aef93271eea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc74 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946510.688464:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914680031200, rc 0) 00000100:00100000:3.0:1790946510.688801:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec4ece38-7293-498c-8428-4d215a1f0fd0+12:5602:x1877943286519680:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 Request processed in 417us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946510.688824:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 268 00000100:00100000:1.0:1790946510.701595:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946510.703472:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286519808 00000100:00100000:0.0:1790946510.703567:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286519808 00000100:00100000:0.0:1790946510.703692:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 269 00000100:00100000:0.0:1790946510.703705:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+12:5602:x1877943286519808:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790946510.704056:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+12:5602:x1877943286519808:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 Request processed in 346us (2463us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946510.704065:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 269 00000100:00100000:0.0:1790946510.714374:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946510.714805:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286519936 00000100:00100000:1.0:1790946510.714819:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286519936 00000100:00100000:1.0:1790946510.714884:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 270 00000100:00100000:1.0:1790946510.714911:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec4ece38-7293-498c-8428-4d215a1f0fd0+12:5602:x1877943286519936:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790946510.715876:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec4ece38-7293-498c-8428-4d215a1f0fd0+12:5602:x1877943286519936:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 Request processed in 961us (1510us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946510.715888:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 270 00000100:00100000:2.0:1790946510.724190:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946510.724572:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286520064 00000100:00100000:0.0:1790946510.724585:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286520064 00000100:00100000:0.0:1790946510.724861:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 271 00000100:00100000:0.0:1790946510.724873:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+12:9959:x1877943286520064:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790946510.725258:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+12:9959:x1877943286520064:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 387us (1080us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946510.725267:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 271 00000100:00100000:2.0:1790946510.733427:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946510.733540:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286520192 00000100:00100000:1.0:1790946510.733676:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286520192 00000100:00100000:1.0:1790946510.733990:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 272 00000100:00100000:1.0:1790946510.734004:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec4ece38-7293-498c-8428-4d215a1f0fd0+12:9959:x1877943286520192:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790946510.734368:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec4ece38-7293-498c-8428-4d215a1f0fd0+12:9959:x1877943286520192:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 368us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946510.734377:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 272 00000100:00100000:1.0:1790946510.741369:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946510.741481:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286520320 00000100:00100000:0.0:1790946510.741494:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286520320 00000100:00100000:0.0:1790946510.741557:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 273 00000100:00100000:0.0:1790946510.741568:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+12:5602:x1877943286520320:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790946510.741589:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946510.741612:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9146c20cbc00/0x16e41aef93271ef1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cc7b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946510.741712:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9146c20cbc00/0x16e41aef93271ef1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc7b expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946510.741788:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9146c20cbc00/0x16e41aef93271ef1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc7b expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946510.741820:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146c20cbc00, rc 0) 00000100:00100000:0.0:1790946510.741902:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:5602:x1877943286520320:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 Request processed in 336us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946510.741911:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 273 00000100:00100000:0.0:1790946510.744796:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946510.745090:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286520448 00000100:00100000:1.0:1790946510.745101:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286520448 00000100:00100000:1.0:1790946510.745159:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 274 00000100:00100000:1.0:1790946510.745170:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:5602:x1877943286520448:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790946510.745981:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:5602:x1877943286520448:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 Request processed in 801us (1187us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946510.745992:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 274 00000100:00100000:2.0:1790946510.754090:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946510.754256:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286520576 00000100:00100000:3.0:1790946510.754268:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286520576 00000100:00100000:3.0:1790946510.754325:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 275 00000100:00100000:3.0:1790946510.754336:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:5602:x1877943286520576:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790946510.754620:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:5602:x1877943286520576:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 Request processed in 285us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946510.754640:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 275 00000100:00100000:2.0:1790946510.759457:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946510.759564:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286520704 00000100:00100000:1.0:1790946510.759576:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286520704 00000100:00100000:1.0:1790946510.759645:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 276 00000100:00100000:1.0:1790946510.759657:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:9962:x1877943286520704:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790946510.760037:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:9962:x1877943286520704:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 382us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946510.760056:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 276 00000100:00100000:1.0:1790946510.767005:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946510.767163:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286520832 00000100:00100000:0.0:1790946510.767176:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286520832 00000100:00100000:0.0:1790946510.767265:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 277 00000100:00100000:0.0:1790946510.767276:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:9962:x1877943286520832:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790946510.767577:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:9962:x1877943286520832:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 302us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946510.767586:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 277 00000040:00080000:0.0:1790946510.899639:0:11687:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1790946511.153786:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946512.176437:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946512.615236:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946512.615294:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946512.615360:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286520960 00000100:00100000:3.0:1790946512.615378:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286520960 00000100:00100000:2.0:1790946512.615510:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946512.615550:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946512.615556:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 278 00000100:00100000:3.0:1790946512.615574:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:2361:x1877943286520960:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790946512.615628:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286521088 00000100:00100000:2.0:1790946512.615638:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286521088 00000100:00100000:2.0:1790946512.615699:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286521344 00000100:00100000:2.0:1790946512.615702:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286521344 00000100:00100000:2.0:1790946512.615728:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 107 00000100:00100000:2.0:1790946512.615737:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+5:2361:x1877943286521088:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790946512.615837:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:2361:x1877943286520960:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 267us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946512.621253:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286521216 00000100:00100000:0.0:1790946512.621276:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286521216 00000100:00100000:0.0:1790946512.621371:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 61 00000100:00100000:2.0:1790946512.622458:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+5:2361:x1877943286521088:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 6712us (6941us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946512.622473:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 107 00000100:00100000:2.0:1790946512.622512:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 108 00000100:00100000:2.0:1790946512.622523:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+5:2361:x1877943286521344:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1790946512.623368:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+5:2361:x1877943286521216:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790946512.623497:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+5:2361:x1877943286521344:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 974us (7944us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946512.623507:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 108 00000100:00080000:2.0:1790946512.624321:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790946512.624330:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790946512.624447:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+5:2361:x1877943286521216:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 3063us (9149us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946512.624458:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 61 00000100:00100000:3.0:1790946512.636893:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 278 00000100:00100000:0.0:1790946512.885131:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146875b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3302:1877943303333632:0@lo:400:kworker.0 00000100:00100000:0.0:1790946512.885266:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946512.885351:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146875b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1877943303334144:0@lo:400:kworker.0 00000100:00100000:0.0:1790946512.886761:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946512.886823:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1790946512.886834:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146875b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877943303333760:0@lo:400:kworker.0 00000100:00100000:0.0:1790946512.886862:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946512.886883:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146875b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303334272:0@lo:400:kworker.0 00000100:00100000:0.0:1790946512.886906:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946512.888393:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303333632 00000100:00100000:1.0:1790946512.888412:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303333632 00000100:00100000:0.0:1790946512.888573:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146875b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1877943303333888:0@lo:400:kworker.0 00000100:00100000:0.0:1790946512.888650:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946512.888702:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790946512.888707:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1790946512.888716:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146875b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303334016:0@lo:400:kworker.0 00000100:00100000:1.0:1790946512.888724:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3302:x1877943303333632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946512.888752:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946512.888806:0:11315:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303334144 00000100:00100000:0.0:1790946512.888814:0:11315:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303334144 00000100:00100000:0.0:1790946512.888864:0:11315:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303333760 00000100:00100000:0.0:1790946512.888867:0:11315:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303333760 00000100:00100000:0.0:1790946512.888884:0:11315:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303333888 00000100:00100000:0.0:1790946512.888887:0:11315:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303333888 00000100:00100000:0.0:1790946512.888905:0:11315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1790946512.888913:0:11315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146875b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877943303334144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946512.888987:0:11315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146875b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877943303334144:12345-0@lo:400:kworker.0 Request processed in 74us (2235us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946512.888994:0:11315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1790946512.889015:0:11315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1790946512.889020:0:11315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146875b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877943303333760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946512.889060:0:11315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146875b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877943303333760:12345-0@lo:400:kworker.0 Request processed in 35us (2193us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946512.889065:0:11315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1790946512.889097:0:11315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1790946512.889103:0:11315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146875b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1877943303333888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946512.889139:0:11315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146875b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1877943303333888:12345-0@lo:400:kworker.0 Request processed in 36us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946512.889145:0:11315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1790946512.889171:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303334272 00000100:00100000:0.0:1790946512.889175:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303334272 00000100:00100000:0.0:1790946512.889219:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303334016 00000100:00100000:0.0:1790946512.889221:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303334016 00000100:00100000:0.0:1790946512.889241:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790946512.889247:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146875b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3302:x1877943303334272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946512.889294:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146875b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3302:x1877943303334272:12345-0@lo:400:kworker.0 Request processed in 33us (2372us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946512.889301:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790946512.889312:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790946512.889319:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146875b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303334016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946512.889358:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146875b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303334016:12345-0@lo:400:kworker.0 Request processed in 40us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946512.889364:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1790946512.890432:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3302:x1877943303333632:12345-0@lo:400:kworker.0 Request processed in 1704us (5157us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946512.890445:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00080000:2.0:1790946512.891980:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790946512.891992:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790946512.891996:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790946512.915358:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146875b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877943303333760:0@lo:400:kworker.0 00000100:00100000:2.0:1790946512.919641:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146875b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303334272:0@lo:400:kworker.0 00000100:00100000:2.0:1790946512.919695:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146875b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3302:1877943303333632:0@lo:400:kworker.0 00000100:00100000:2.0:1790946512.919710:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146875b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1877943303334144:0@lo:400:kworker.0 00010000:00080000:0.0:1790946512.923889:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146875b1180 x1877943303334016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790946528 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946512.923911:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146875b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303334016:0@lo:400:kworker.0 00000100:00100000:0.0:1790946512.926265:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146875b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1877943303333888:0@lo:400:kworker.0 00000001:00080000:3.0:1790946513.014541:0:7645:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:3.0:1790946513.200427:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946513.392453:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146becb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303334400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790946513.392523:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946513.395856:0:6676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303334400 00000100:00100000:1.0:1790946513.395871:0:6676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303334400 00000100:00100000:1.0:1790946513.395943:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790946513.395961:0:6676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146875b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303334400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790946513.395998:0:6676:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790946513.396085:0:6676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146875b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303334400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (3561us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946513.396093:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1790946513.396244:0:3300:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1790946513.396250:0:3300:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9146beee4a80, transno 4294967300 00000100:00100000:0.0:1790946513.396275:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146becb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303334400:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790946514.226075:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946515.249452:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946515.440563:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146becb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303334528:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790946515.440787:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946515.441736:0:6676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303334528 00000100:00100000:1.0:1790946515.441750:0:6676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303334528 00000100:00080000:2.0:1790946515.441822:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790946515.441828:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1790946515.441840:0:6676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be075c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1877943303334528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790946515.441876:0:6676:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790946515.441956:0:6676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be075c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1877943303334528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (1169us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946515.441964:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:3.0:1790946515.442054:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146becb4700 x1877943303334528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790946531 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946515.442686:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146becb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303334528:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1790946516.272626:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946517.296442:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946517.729472:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946517.729516:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946517.729559:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946517.729588:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946517.729666:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286521600 00000100:00100000:1.0:1790946517.729690:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286521600 00000100:00100000:1.0:1790946517.729750:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286521856 00000100:00100000:1.0:1790946517.729753:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286521856 00000100:00100000:1.0:1790946517.729772:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 112 00000100:00100000:1.0:1790946517.729780:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+5:2363:x1877943286521600:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790946517.729845:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+5:2363:x1877943286521600:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 66us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946517.729851:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 112 00000100:00100000:1.0:1790946517.729866:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 113 00000100:00100000:1.0:1790946517.729871:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+5:2363:x1877943286521856:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790946517.729890:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+5:2363:x1877943286521856:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 20us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946517.729897:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 113 00000100:00100000:3.0:1790946517.730147:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286521472 00000100:00100000:3.0:1790946517.730152:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286521472 00000100:00100000:3.0:1790946517.730185:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 280 00000100:00100000:3.0:1790946517.730191:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:2363:x1877943286521472:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790946517.730246:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:2363:x1877943286521472:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 55us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946517.730252:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 280 00000100:00080000:2.0:1790946517.730382:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790946517.730866:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286521728 00000100:00100000:0.0:1790946517.730872:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286521728 00000100:00100000:0.0:1790946517.730940:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 64 00000100:00100000:0.0:1790946517.730949:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+5:2363:x1877943286521728:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1790946517.731240:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+5:2363:x1877943286521728:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 292us (1650us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946517.731247:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 64 00000100:00080000:2.0:1790946517.731572:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790946518.001414:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3302:1877943303334656:0@lo:400:kworker.0 00000100:00100000:2.0:1790946518.004384:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877943303334784:0@lo:400:kworker.0 00000100:00100000:2.0:1790946518.004459:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946518.004516:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146beee4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303335296:0@lo:400:kworker.0 00000100:00100000:2.0:1790946518.004541:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946518.004583:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790946518.004588:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b6318000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1877943303335168:0@lo:400:kworker.0 00000100:00100000:2.0:1790946518.004607:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946518.004633:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914685634e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303335040:0@lo:400:kworker.0 00000100:00100000:2.0:1790946518.004654:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946518.004671:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790946518.004676:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1877943303334912:0@lo:400:kworker.0 00000100:00100000:2.0:1790946518.004693:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946518.004717:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303334784 00000100:00100000:2.0:1790946518.004723:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303334784 00000100:00100000:2.0:1790946518.004756:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303335168 00000100:00100000:2.0:1790946518.004759:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303335168 00000100:00100000:2.0:1790946518.004791:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303334912 00000100:00100000:2.0:1790946518.004794:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303334912 00000100:00100000:2.0:1790946518.004810:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1790946518.004816:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beee5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877943303334784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946518.004862:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beee5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877943303334784:12345-0@lo:400:kworker.0 Request processed in 46us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946518.004869:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1790946518.004884:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1790946518.004889:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beee6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877943303335168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946518.004911:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beee6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877943303335168:12345-0@lo:400:kworker.0 Request processed in 23us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946518.004929:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1790946518.004940:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1790946518.004946:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beee5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1877943303334912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946518.004975:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beee5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1877943303334912:12345-0@lo:400:kworker.0 Request processed in 29us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946518.004986:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1790946518.005400:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303335296 00000100:00100000:2.0:1790946518.005404:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303335296 00000100:00100000:2.0:1790946518.005434:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303335040 00000100:00100000:2.0:1790946518.005436:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303335040 00000100:00100000:2.0:1790946518.005457:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790946518.005464:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beee4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1877943303335296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946518.005504:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beee4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1877943303335296:12345-0@lo:400:kworker.0 Request processed in 40us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946518.005511:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1790946518.005654:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790946518.005681:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beee7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1877943303335040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946518.005770:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beee7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1877943303335040:12345-0@lo:400:kworker.0 Request processed in 104us (1114us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946518.005778:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:2.0:1790946518.005846:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790946518.005851:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790946518.005855:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790946518.005890:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1877943303334912:0@lo:400:kworker.0 00010000:00080000:2.0:1790946518.005911:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff914685634e00 x1877943303335040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790946534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946518.005933:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914685634e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303335040:0@lo:400:kworker.0 00000100:00100000:2.0:1790946518.005972:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b6318000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1877943303335168:0@lo:400:kworker.0 00000100:00100000:2.0:1790946518.005984:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877943303334784:0@lo:400:kworker.0 00000100:00100000:2.0:1790946518.005992:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146beee4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303335296:0@lo:400:kworker.0 00000100:00100000:2.0:1790946518.006048:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946518.006115:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303334656 00000100:00100000:2.0:1790946518.006119:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303334656 00000100:00100000:2.0:1790946518.006378:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1790946518.006385:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3302:x1877943303334656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946518.006441:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3302:x1877943303334656:12345-0@lo:400:kworker.0 Request processed in 55us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946518.006449:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1790946518.016695:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3302:1877943303334656:0@lo:400:kworker.0 00010000:00010000:2.0:1790946518.320531:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946518.512594:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146becb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303335424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790946518.512666:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946518.512800:0:6676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303335424 00000100:00100000:0.0:1790946518.512807:0:6676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303335424 00000100:00100000:0.0:1790946518.512851:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1790946518.512859:0:6676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beee4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303335424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790946518.512891:0:6676:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790946518.513141:0:6676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beee4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303335424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 283us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946518.513149:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790946518.513233:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146becb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303335424:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790946519.344799:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790946520.115073:0:11687:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790946520.369226:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946520.560886:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790946520.560928:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146becb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303335552:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790946520.561022:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946520.561159:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303335552 00000100:00100000:0.0:1790946520.561169:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303335552 00000100:00100000:0.0:1790946520.561261:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790946520.561299:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beee7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303335552:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1790946520.561525:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1790946520.561581:0:6678:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790946520.561712:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beee7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303335552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 424us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946520.561720:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:2.0:1790946520.561809:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146becb6680 x1877943303335552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790946536 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946520.561829:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146becb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303335552:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790946521.393966:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946522.416487:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946522.849441:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946522.849499:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946522.849663:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286521984 00000100:00100000:1.0:1790946522.849676:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286521984 00000100:00100000:1.0:1790946522.849751:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 282 00000100:00100000:1.0:1790946522.849762:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:2364:x1877943286521984:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790946522.849861:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:2364:x1877943286521984:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 100us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946522.849870:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 282 00000100:00100000:3.0:1790946522.850020:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286522112 00000100:00100000:3.0:1790946522.850025:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286522112 00000100:00100000:3.0:1790946522.850087:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 117 00000100:00100000:3.0:1790946522.850095:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b6318000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+5:2364:x1877943286522112:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790946522.850133:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b6318000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+5:2364:x1877943286522112:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 40us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946522.850140:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 117 00000100:00080000:0.0:1790946522.850194:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790946522.868851:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946522.868977:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946522.871346:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286522368 00000100:00100000:3.0:1790946522.871369:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286522368 00000100:00100000:3.0:1790946522.871497:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 118 00000100:00100000:3.0:1790946522.871510:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146becb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+5:2363:x1877943286522368:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790946522.871743:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146becb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+5:2363:x1877943286522368:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 234us (2764us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946522.871753:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 118 00000100:00080000:0.0:1790946522.872842:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790946522.875999:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286522240 00000100:00100000:2.0:1790946522.876021:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286522240 00000100:00100000:2.0:1790946522.876142:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:2.0:1790946522.876155:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146becb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+5:2360:x1877943286522240:12345-192.168.203.13@tcp:9:kworker.0 00000020:00000080:2.0:1790946522.876196:0:6673:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x16e41aef93271e2d 00000100:00080000:2.0:1790946522.876223:0:6673:0:(import.c:65:import_set_state_nolock()) ffff914684985000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790946522.876300:0:6673:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00080000:0.0:1790946522.876712:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790946522.877778:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146becb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+2:2360:x1877943286522240:12345-192.168.203.13@tcp:9:kworker.0 Request processed in 1618us (8934us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946522.877791:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 19 00010000:00010000:1.0:1790946522.878151:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946523.120670:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be97b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303336064:0@lo:400:kworker.0 00000100:00100000:3.0:1790946523.120779:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946523.120885:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790946523.120893:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1877943303335936:0@lo:400:kworker.0 00000100:00100000:3.0:1790946523.120924:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946523.120966:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303336064 00000100:00100000:3.0:1790946523.120976:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303336064 00000100:00100000:3.0:1790946523.121050:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790946523.121060:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be978a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1877943303336064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946523.121132:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be978a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1877943303336064:12345-0@lo:400:kworker.0 Request processed in 73us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946523.121141:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790946523.121169:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303335936 00000100:00100000:3.0:1790946523.121172:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303335936 00000100:00100000:3.0:1790946523.121241:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1790946523.121250:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be97b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1877943303335936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946523.121283:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be97b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1877943303335936:12345-0@lo:400:kworker.0 Request processed in 34us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946523.121289:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:3.0:1790946523.121314:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790946523.121320:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790946523.121407:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1877943303335936:0@lo:400:kworker.0 00010000:00080000:3.0:1790946523.121422:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146be97b480 x1877943303336064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790946539 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946523.121433:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be97b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303336064:0@lo:400:kworker.0 00000100:00100000:2.0:1790946523.122225:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be97b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3302:1877943303335680:0@lo:400:kworker.0 00000100:00100000:2.0:1790946523.122284:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946523.122330:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be979500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1877943303336192:0@lo:400:kworker.0 00000100:00100000:2.0:1790946523.122360:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946523.122400:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1790946523.122407:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be978380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877943303335808:0@lo:400:kworker.0 00000100:00100000:2.0:1790946523.122430:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946523.122448:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be979f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303336320:0@lo:400:kworker.0 00000100:00100000:2.0:1790946523.122470:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946523.122498:0:11315:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303336192 00000100:00100000:2.0:1790946523.122503:0:11315:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303336192 00000100:00100000:2.0:1790946523.122671:0:11315:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303335808 00000100:00100000:2.0:1790946523.122675:0:11315:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303335808 00000100:00100000:2.0:1790946523.122697:0:11315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1790946523.122705:0:11315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914685634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877943303336192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946523.122762:0:11315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914685634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877943303336192:12345-0@lo:400:kworker.0 Request processed in 58us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946523.122768:0:11315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1790946523.122782:0:11315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1790946523.122788:0:11315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877943303335808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946523.122812:0:11315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877943303335808:12345-0@lo:400:kworker.0 Request processed in 25us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946523.122836:0:11315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1790946523.124464:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be978380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877943303335808:0@lo:400:kworker.0 00000100:00100000:2.0:1790946523.124504:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be979500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1877943303336192:0@lo:400:kworker.0 00000100:00100000:3.0:1790946523.124994:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303335680 00000100:00100000:3.0:1790946523.125020:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303335680 00000100:00100000:3.0:1790946523.125079:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1790946523.125089:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3302:x1877943303335680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946523.125188:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3302:x1877943303335680:12345-0@lo:400:kworker.0 Request processed in 101us (2904us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946523.125196:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1790946523.125259:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303336320 00000100:00100000:3.0:1790946523.125264:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303336320 00000100:00100000:3.0:1790946523.125301:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1790946523.125308:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303336320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946523.125358:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303336320:12345-0@lo:400:kworker.0 Request processed in 51us (2887us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946523.125365:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:3.0:1790946523.125398:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790946523.125404:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790946523.125866:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be979f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303336320:0@lo:400:kworker.0 00000100:00100000:2.0:1790946523.127010:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be97b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3302:1877943303335680:0@lo:400:kworker.0 00000001:00100000:3.0:1790946523.237997:0:7645:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7eed1f4b-bd5b-4a70-8045-59db065b3dfc 00000020:00000080:3.0:1790946523.238008:0:7645:0:(genops.c:885:class_export_put()) final put ffff914684987800/7eed1f4b-bd5b-4a70-8045-59db065b3dfc 00000020:00000080:1.0:1790946523.238088:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff914684987800/7eed1f4b-bd5b-4a70-8045-59db065b3dfc for lustre-OST0001 00000020:00000080:1.0:1790946523.238148:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff914684985000 for lustre-OST0001 00010000:00010000:2.0:1790946523.441000:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946523.632765:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146becb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303336448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790946523.632883:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946523.633103:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303336448 00000100:00100000:0.0:1790946523.633117:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303336448 00000100:00100000:0.0:1790946523.633175:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1790946523.633185:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303336448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790946523.633268:0:6678:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790946523.633329:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303336448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 145us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946523.633338:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1790946523.633634:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146becb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303336448:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790946524.464506:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946525.488553:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946525.680496:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146becb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303336576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790946525.680567:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946525.680743:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303336576 00000100:00100000:0.0:1790946525.680753:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303336576 00000100:00100000:0.0:1790946525.680826:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1790946525.680837:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be97b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1877943303336576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790946525.680881:0:6678:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790946525.680939:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be97b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1877943303336576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946525.680946:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:2.0:1790946525.681237:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146becb4e00 x1877943303336576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790946541 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946525.681256:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146becb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303336576:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1790946525.681318:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790946526.512823:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946527.536582:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946527.970235:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946527.970326:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946527.970352:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946527.972692:0:11315:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286522624 00000100:00100000:2.0:1790946527.972709:0:11315:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286522624 00000100:00100000:2.0:1790946527.972788:0:11315:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286522752 00000100:00100000:2.0:1790946527.972791:0:11315:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286522752 00000100:00100000:2.0:1790946527.972821:0:11315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 122 00000100:00100000:2.0:1790946527.972847:0:11315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146becb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+5:2364:x1877943286522624:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790946527.972929:0:11315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146becb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+5:2364:x1877943286522624:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 99us (2602us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946527.972937:0:11315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 122 00000100:00100000:2.0:1790946527.972967:0:11315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 123 00000100:00100000:2.0:1790946527.972973:0:11315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146becb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+5:2363:x1877943286522752:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790946527.973189:0:11315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146becb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+5:2363:x1877943286522752:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 215us (2834us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946527.973197:0:11315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 123 00000100:00080000:1.0:1790946527.975468:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790946527.975663:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286522496 00000100:00100000:0.0:1790946527.975673:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286522496 00000100:00100000:0.0:1790946527.975739:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 284 00000100:00100000:0.0:1790946527.975748:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:2363:x1877943286522496:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1790946527.975862:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:2363:x1877943286522496:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 107us (5629us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946527.975871:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 284 00000100:00100000:0.0:1790946528.240600:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be97a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877943303336832:0@lo:400:kworker.0 00000100:00100000:0.0:1790946528.240676:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946528.240733:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be97a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303337344:0@lo:400:kworker.0 00000100:00100000:0.0:1790946528.240757:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946528.240788:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1790946528.240794:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3303:1877943303336704:0@lo:400:kworker.0 00000100:00100000:0.0:1790946528.240828:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946528.241133:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be97ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1877943303336960:0@lo:400:kworker.0 00000100:00100000:2.0:1790946528.241166:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946528.241193:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790946528.241220:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303337088:0@lo:400:kworker.0 00000100:00100000:2.0:1790946528.241242:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946528.241269:0:6808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303337344 00000100:00100000:2.0:1790946528.241276:0:6808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303337344 00000100:00100000:2.0:1790946528.241334:0:6808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303337088 00000100:00100000:2.0:1790946528.241337:0:6808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303337088 00000100:00100000:2.0:1790946528.241357:0:6808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1790946528.241371:0:6808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146875b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1877943303337344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946528.241421:0:6808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146875b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1877943303337344:12345-0@lo:400:kworker.0 Request processed in 57us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946528.241433:0:6808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1790946528.241448:0:6808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1790946528.241454:0:6808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bdcc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303337088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946528.241482:0:6808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bdcc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303337088:12345-0@lo:400:kworker.0 Request processed in 29us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946528.241488:0:6808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:2.0:1790946528.241502:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790946528.241506:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1790946528.241543:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146be979180 x1877943303337088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790946544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946528.241555:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303337088:0@lo:400:kworker.0 00000100:00100000:3.0:1790946528.241910:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303336832 00000100:00100000:3.0:1790946528.241916:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303336832 00000100:00100000:3.0:1790946528.241945:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303336960 00000100:00100000:3.0:1790946528.241947:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303336960 00000100:00100000:3.0:1790946528.241967:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1790946528.241974:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146875b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877943303336832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946528.242014:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146875b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877943303336832:12345-0@lo:400:kworker.0 Request processed in 41us (1338us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946528.242029:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1790946528.242042:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1790946528.242046:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bdcc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1877943303336960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946528.242074:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bdcc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1877943303336960:12345-0@lo:400:kworker.0 Request processed in 27us (908us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946528.242080:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:2.0:1790946528.242293:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790946528.242317:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be97ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1877943303336960:0@lo:400:kworker.0 00000100:00100000:0.0:1790946528.243726:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1877943303337216:0@lo:400:kworker.0 00000100:00100000:0.0:1790946528.243784:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946528.244014:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303336704 00000100:00100000:2.0:1790946528.244022:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303336704 00000100:00100000:0.0:1790946528.244048:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be97a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877943303336832:0@lo:400:kworker.0 00000100:00100000:0.0:1790946528.244066:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be97a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303337344:0@lo:400:kworker.0 00000100:00100000:2.0:1790946528.244099:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1790946528.244107:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3303:x1877943303336704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946528.244161:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3303:x1877943303336704:12345-0@lo:400:kworker.0 Request processed in 54us (3338us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946528.244167:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1790946528.246472:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3303:1877943303336704:0@lo:400:kworker.0 00000100:00100000:0.0:1790946528.246588:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303337216 00000100:00100000:0.0:1790946528.246603:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303337216 00000100:00080000:0.0:1790946528.246638:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790946528.246698:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1790946528.246708:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146875b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877943303337216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946528.249586:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146875b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877943303337216:12345-0@lo:400:kworker.0 Request processed in 2869us (5795us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946528.249601:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1790946528.256340:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1877943303337216:0@lo:400:kworker.0 00010000:00010000:1.0:1790946528.560537:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946528.754178:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146becb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303337472:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790946528.754288:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946528.754696:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303337472 00000100:00100000:0.0:1790946528.754706:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303337472 00000100:00100000:0.0:1790946528.754775:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1790946528.754784:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bdcc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303337472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790946528.754821:0:6678:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790946528.755005:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bdcc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303337472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 221us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946528.755012:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790946528.755439:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146becb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303337472:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790946529.587037:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790946530.369373:0:11687:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790946530.609317:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946530.802682:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790946530.802706:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146becb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303337600:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790946530.802778:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946530.802882:0:6676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303337600 00000100:00100000:1.0:1790946530.802891:0:6676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303337600 00000100:00100000:1.0:1790946530.802953:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790946530.802963:0:6676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146875b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303337600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790946530.802998:0:6676:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790946530.803045:0:6676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146875b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303337600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946530.803053:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:1.0:1790946530.803094:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146becb5c00 x1877943303337600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790946546 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946530.803110:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146becb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303337600:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1790946530.803161:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790946531.632418:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946532.664595:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946533.097027:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946533.097086:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946533.097180:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286523008 00000100:00100000:3.0:1790946533.097193:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286523008 00000100:00100000:3.0:1790946533.097472:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 127 00000100:00100000:3.0:1790946533.097486:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146becb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+5:2361:x1877943286523008:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790946533.097593:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146becb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+5:2361:x1877943286523008:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 110us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946533.097602:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 127 00000100:00100000:2.0:1790946533.097889:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286522880 00000100:00100000:2.0:1790946533.097899:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286522880 00000100:00100000:2.0:1790946533.097949:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 286 00000100:00100000:2.0:1790946533.097957:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:2361:x1877943286522880:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790946533.097992:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:2361:x1877943286522880:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 36us (986us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946533.097999:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 286 00000100:00080000:1.0:1790946533.098680:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790946533.117655:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946533.117755:0:11315:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286523136 00000100:00100000:2.0:1790946533.117769:0:11315:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286523136 00000100:00100000:2.0:1790946533.117882:0:11315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 128 00000100:00100000:2.0:1790946533.117903:0:11315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146becb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+5:2362:x1877943286523136:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790946533.118007:0:11315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146becb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+5:2362:x1877943286523136:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 106us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946533.118024:0:11315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 128 00000100:00080000:1.0:1790946533.118584:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1790946533.130774:0:11854:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 09:08:51 (1790946531) 00000100:00100000:1.0:1790946533.361750:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146becb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3302:1877943303337728:0@lo:400:kworker.0 00000100:00100000:3.0:1790946533.362153:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146becb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877943303337856:0@lo:400:kworker.0 00000100:00100000:3.0:1790946533.362288:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946533.362359:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914688711180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303338368:0@lo:400:kworker.0 00000100:00100000:3.0:1790946533.362394:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946533.362470:0:6808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303338368 00000100:00100000:3.0:1790946533.362479:0:6808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303338368 00000100:00100000:3.0:1790946533.362538:0:6808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1790946533.362665:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946533.362718:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914688712d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1877943303338240:0@lo:400:kworker.0 00000100:00100000:1.0:1790946533.362765:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946533.362822:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146becb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1877943303337984:0@lo:400:kworker.0 00000100:00100000:1.0:1790946533.362862:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946533.362889:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790946533.362898:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146becb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303338112:0@lo:400:kworker.0 00000100:00100000:1.0:1790946533.362927:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946533.362963:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303337728 00000100:00100000:1.0:1790946533.362970:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303337728 00000100:00100000:1.0:1790946533.363012:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1790946533.363033:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3302:x1877943303337728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946533.363094:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3302:x1877943303337728:12345-0@lo:400:kworker.0 Request processed in 62us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946533.363102:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1790946533.363143:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303337856 00000100:00100000:1.0:1790946533.363147:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303337856 00000100:00100000:3.0:1790946533.363161:0:6808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1877943303338368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946533.363177:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303338240 00000100:00100000:1.0:1790946533.363184:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303338240 00000100:00100000:1.0:1790946533.363240:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303337984 00000100:00100000:1.0:1790946533.363244:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303337984 00000100:00100000:1.0:1790946533.363266:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1790946533.363275:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be978e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877943303337856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946533.363286:0:6808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1877943303338368:12345-0@lo:400:kworker.0 Request processed in 736us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946533.363298:0:6808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790946533.363325:0:6808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303338112 00000100:00100000:1.0:1790946533.363329:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be978e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877943303337856:12345-0@lo:400:kworker.0 Request processed in 53us (1039us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946533.363335:0:6808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303338112 00000100:00100000:1.0:1790946533.363341:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1790946533.363366:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1790946533.363378:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914688710e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877943303338240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946533.363387:0:6808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790946533.363397:0:6808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914688713b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303338112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946533.363447:0:6808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914688713b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303338112:12345-0@lo:400:kworker.0 Request processed in 52us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946533.363453:0:6808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:3.0:1790946533.363486:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790946533.363491:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790946533.363493:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790946533.363508:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1790946533.363516:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914688712300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1877943303337984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946533.365193:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914688712300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1877943303337984:12345-0@lo:400:kworker.0 Request processed in 1667us (2320us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946533.365234:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00010000:00080000:3.0:1790946533.365324:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146becb4e00 x1877943303338112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790946549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946533.365340:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146becb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303338112:0@lo:400:kworker.0 00000100:00100000:3.0:1790946533.365355:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146becb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1877943303337984:0@lo:400:kworker.0 00000100:00100000:3.0:1790946533.365422:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146becb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877943303337856:0@lo:400:kworker.0 00000100:00100000:3.0:1790946533.365435:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914688711180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303338368:0@lo:400:kworker.0 00000100:00100000:1.0:1790946533.366094:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914688710e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877943303338240:12345-0@lo:400:kworker.0 Request processed in 2703us (3311us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946533.366437:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1790946533.366541:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146becb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3302:1877943303337728:0@lo:400:kworker.0 00000100:00100000:1.0:1790946533.366562:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914688712d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1877943303338240:0@lo:400:kworker.0 00010000:00010000:3.0:1790946533.681563:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946533.872726:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914688712d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303338496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790946533.872847:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946533.872957:0:6676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303338496 00000100:00100000:1.0:1790946533.872968:0:6676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303338496 00000100:00100000:1.0:1790946533.873037:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1790946533.873049:0:6676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914688711880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303338496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790946533.873100:0:6676:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790946533.873153:0:6676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914688711880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303338496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946533.873161:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1790946533.875245:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914688712d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303338496:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790946534.704521:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946534.755480:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946534.755606:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286523264 00000100:00100000:0.0:1790946534.755616:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286523264 00000100:00100000:0.0:1790946534.755684:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 32 00000100:00100000:0.0:1790946534.755692:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bdcc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+5:10230:x1877943286523264:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790946534.755713:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946534.755736:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cb200/0x16e41aef93271ef8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cc82 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946534.755815:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cac00/0x16e41aef93271eff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946534.755839:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cac00/0x16e41aef93271eff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946534.755852:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cac00/0x16e41aef93271eff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790946534.755898:0:5836:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790946534.755915:0:5836:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790946534.755957:0:5836:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cac00/0x16e41aef93271eff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946534.755981:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cb200/0x16e41aef93271ef8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc82 expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946534.755999:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cac00/0x16e41aef93271eff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc82 expref: 6 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946534.756007:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff914686750900) 00010000:00010000:0.0:1790946534.756010:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790946534.756013:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146c20cac00, rc 0) 00000100:00100000:0.0:1790946534.756083:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bdcc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:10230:x1877943286523264:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 391us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946534.756091:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 32 00000100:00100000:2.0:1790946534.760870:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946534.761013:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286523392 00000100:00100000:3.0:1790946534.761023:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286523392 00000100:00100000:3.0:1790946534.761088:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 33 00000100:00100000:3.0:1790946534.761098:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:10231:x1877943286523392:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790946534.761119:0:6803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946534.761137:0:6803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a200/0x16e41aef93271f06 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cc89 expref: -99 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946534.761254:0:6803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef93271f0d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946534.761268:0:6803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef93271f0d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946534.761278:0:6803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef93271f0d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946534.761290:0:6803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93271f14 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946534.761524:0:6803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93271f14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946534.761535:0:6803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93271f14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946534.762016:0:6803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a000/0x16e41aef93271f1b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946534.762028:0:6803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a000/0x16e41aef93271f1b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946534.762036:0:6803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a000/0x16e41aef93271f1b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790946534.762064:0:6803:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790946534.762087:0:6803:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790946534.762110:0:6803:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a000/0x16e41aef93271f1b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946534.762120:0:6803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef93271f0d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946534.762127:0:6803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef93271f0d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946534.762134:0:6803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef93271f0d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946534.762140:0:6803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146a032a800 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946534.762145:0:6803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef93271f0d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946534.762152:0:6803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef93271f0d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946534.762163:0:6803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff914686750900) 00010000:00010000:3.0:1790946534.762172:0:6803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946534.762178:0:6803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef93271f0d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946534.762184:0:6803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef93271f0d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946534.762198:0:6803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93271f14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946534.762936:0:6803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93271f14 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946534.762943:0:6803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93271f14 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946534.762949:0:6803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146a032b400 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946534.762951:0:6803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93271f14 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946534.762958:0:6803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93271f14 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946534.762969:0:6803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9146836df000) 00010000:00010000:3.0:1790946534.762972:0:6803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946534.762976:0:6803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93271f14 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946534.762981:0:6803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93271f14 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946534.763028:0:6803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a200/0x16e41aef93271f06 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc89 expref: 8 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946534.763059:0:6803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a000/0x16e41aef93271f1b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc89 expref: 7 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946534.763067:0:6803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9146836dfd00) 00010000:00010000:3.0:1790946534.763082:0:6803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790946534.763085:0:6803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146a032a000, rc 0) 00000100:00100000:3.0:1790946534.763171:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+7:10231:x1877943286523392:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 2065us (2311us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946534.763180:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 33 00000100:00100000:1.0:1790946534.769555:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946534.769739:0:11315:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286523648 00000100:00100000:2.0:1790946534.769748:0:11315:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286523648 00000100:00100000:2.0:1790946534.769812:0:11315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 34 00000100:00100000:2.0:1790946534.769821:0:11315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914688712d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+7:10231:x1877943286523648:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790946534.769841:0:11315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946534.769860:0:11315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef93271f22 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cc90 expref: -99 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946534.769938:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93271f29 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946534.769953:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93271f29 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946534.769964:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93271f29 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946534.770018:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef93271f30 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946534.770026:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef93271f30 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946534.770051:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef93271f30 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946534.771037:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee200/0x16e41aef93271f37 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946534.771051:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee200/0x16e41aef93271f37 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946534.771059:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee200/0x16e41aef93271f37 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790946534.771079:0:11315:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1790946534.771612:0:11315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93271f29 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946534.771622:0:11315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93271f29 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946534.771629:0:11315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93271f29 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946534.771636:0:11315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aee600 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:2.0:1790946534.771640:0:11315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93271f29 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946534.771648:0:11315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93271f29 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946534.771659:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9146836dfd00) 00010000:00010000:2.0:1790946534.771663:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790946534.771675:0:11315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93271f29 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946534.771682:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93271f29 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946534.771695:0:11315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef93271f30 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946534.771701:0:11315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef93271f30 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946534.771707:0:11315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef93271f30 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946534.771713:0:11315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aeec00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:2.0:1790946534.771715:0:11315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef93271f30 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946534.771721:0:11315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef93271f30 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946534.771728:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9146a0a5ec00) 00010000:00010000:2.0:1790946534.771730:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790946534.771733:0:11315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef93271f30 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946534.771738:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef93271f30 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946534.779593:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef93271f22 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc90 expref: 10 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946534.779637:0:11315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee200/0x16e41aef93271f37 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc90 expref: 9 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946534.779647:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9146a0a5e900) 00010000:00010000:2.0:1790946534.779651:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790946534.779655:0:11315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914688aee200, rc 0) 00000100:00100000:2.0:1790946534.779737:0:11315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914688712d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+9:10231:x1877943286523648:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 9916us (10190us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1790946534.782616:0:11315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 34 00000100:00100000:2.0:1790946534.793076:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946534.795499:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286523776 00000100:00100000:0.0:1790946534.795515:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286523776 00000100:00100000:0.0:1790946534.795646:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 35 00000100:00100000:0.0:1790946534.795657:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+9:10231:x1877943286523776:12345-192.168.203.13@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1790946534.795801:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+9:10231:x1877943286523776:12345-192.168.203.13@tcp:59:lhsmtool_posix.0 Request processed in 132us (2722us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946534.795809:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 35 00000040:00080000:3.0:1790946535.481808:0:11687:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790946535.731881:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946535.923275:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790946535.923306:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be97bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303338624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790946535.923399:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946535.924297:0:6676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303338624 00000100:00100000:3.0:1790946535.924312:0:6676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303338624 00000100:00100000:3.0:1790946535.924399:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790946535.924410:0:6676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303338624:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1790946535.924584:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1790946535.924681:0:6676:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790946535.924774:0:6676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303338624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 365us (1374us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946535.924792:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:2.0:1790946535.924948:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9146be97bb80 x1877943303338624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790946551 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946535.924973:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be97bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303338624:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790946536.752560:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946537.131893:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946537.134359:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286523904 00000100:00100000:3.0:1790946537.134381:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286523904 00000100:00100000:3.0:1790946537.134485:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 36 00000100:00100000:3.0:1790946537.134501:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914688712a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+9:10273:x1877943286523904:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1790946537.134529:0:6803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946537.134556:0:6803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a200/0x16e41aef93271f45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cc97 expref: -99 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946537.134650:0:6803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93271f4c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946537.134668:0:6803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93271f4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946537.134684:0:6803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93271f4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946537.134702:0:6803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef93271f53 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946537.134710:0:6803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef93271f53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946537.134717:0:6803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef93271f53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946537.135011:0:6803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93271f4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946537.135021:0:6803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93271f4c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946537.135028:0:6803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93271f4c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946537.135035:0:6803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146a032b400 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946537.135040:0:6803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93271f4c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946537.135063:0:6803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93271f4c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946537.135077:0:6803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff914686750900) 00010000:00010000:3.0:1790946537.135081:0:6803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946537.135087:0:6803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93271f4c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946537.135094:0:6803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93271f4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946537.135108:0:6803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef93271f53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946537.135115:0:6803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef93271f53 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946537.135137:0:6803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef93271f53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946537.135144:0:6803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146a032a800 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946537.135147:0:6803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef93271f53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946537.135154:0:6803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef93271f53 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946537.135162:0:6803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9146836df000) 00010000:00010000:3.0:1790946537.135165:0:6803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946537.135168:0:6803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef93271f53 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946537.135185:0:6803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef93271f53 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946537.135253:0:6803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a200/0x16e41aef93271f45 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc97 expref: 10 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946537.135265:0:6803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff914686750900) 00010000:00010000:3.0:1790946537.135268:0:6803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946537.135272:0:6803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a200/0x16e41aef93271f45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc97 expref: 10 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946537.135282:0:6803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146a032a200, rc 0) 00000100:00100000:3.0:1790946537.135376:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914688712a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+9:10273:x1877943286523904:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 880us (3655us total) trans 0 rc 301/301 00000100:00100000:3.0:1790946537.135386:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 36 00000100:00080000:1.0:1790946537.137289:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790946537.157599:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946537.157845:0:11315:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286524160 00000100:00100000:3.0:1790946537.157869:0:11315:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286524160 00000100:00100000:3.0:1790946537.157941:0:11315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 37 00000100:00100000:3.0:1790946537.157953:0:11315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146875b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+9:10273:x1877943286524160:12345-192.168.203.13@tcp:36:lfs.0 00010000:00010000:3.0:1790946537.158025:0:11315:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790946537.158062:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cac00/0x16e41aef93271eff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc82 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946537.158084:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff914686750900) 00010000:00010000:3.0:1790946537.158097:0:11315:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790946537.159395:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a200/0x16e41aef93271f5a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946537.159434:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a200/0x16e41aef93271f5a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946537.159449:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a200/0x16e41aef93271f5a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946537.159470:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef93271f61 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946537.159477:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef93271f61 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946537.159483:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef93271f61 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790946537.168569:0:11315:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1790946537.168603:0:11315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a200/0x16e41aef93271f5a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946537.168617:0:11315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a200/0x16e41aef93271f5a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946537.168627:0:11315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a200/0x16e41aef93271f5a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946537.168662:0:11315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146a032a200 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:2.0:1790946537.168667:0:11315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a200/0x16e41aef93271f5a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946537.168676:0:11315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a200/0x16e41aef93271f5a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946537.168697:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9146836df000) 00010000:00010000:2.0:1790946537.168700:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790946537.168706:0:11315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a200/0x16e41aef93271f5a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946537.168711:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a200/0x16e41aef93271f5a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790946537.168737:0:11315:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000076b9c409 reply state 000000005b4b3df6 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef93271f61 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946537.168747:0:11315:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790946537.169599:0:11315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146875b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+10:10273:x1877943286524160:12345-192.168.203.13@tcp:36:lfs.0 Request processed in 11639us (12006us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1790946537.169612:0:11315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 37 00010000:00010000:0.0:1790946537.173853:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef93271f61 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946537.173903:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef93271f61 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946537.173913:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef93271f61 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946537.173919:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146a032a800 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:0.0:1790946537.173925:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef93271f61 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946537.173944:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef93271f61 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946537.173965:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9146836df800) 00010000:00010000:0.0:1790946537.173968:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790946537.173974:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef93271f61 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946537.173981:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef93271f61 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946537.275840:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946537.276263:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286524288 00000100:00100000:2.0:1790946537.276279:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286524288 00000100:00100000:2.0:1790946537.276362:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 38 00000100:00100000:2.0:1790946537.276375:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468e93e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+9:10281:x1877943286524288:12345-192.168.203.13@tcp:101:lctl.0 00010000:00010000:2.0:1790946537.276420:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946537.276585:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef93271f68 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cc9e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946537.276696:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeee00/0x16e41aef93271f6f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946537.276715:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeee00/0x16e41aef93271f6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946537.276729:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeee00/0x16e41aef93271f6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790946537.276913:0:5834:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790946537.276919:0:5834:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790946537.276971:0:5834:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeee00/0x16e41aef93271f6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946537.277002:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef93271f68 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc9e expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946537.277023:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeee00/0x16e41aef93271f6f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc9e expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946537.277034:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9146a0a5e400) 00010000:00010000:2.0:1790946537.277037:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790946537.277042:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914688aeee00, rc 0) 00000100:00100000:2.0:1790946537.277135:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468e93e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+10:10281:x1877943286524288:12345-192.168.203.13@tcp:101:lctl.0 Request processed in 762us (1312us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946537.277143:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 38 00000100:00100000:3.0:1790946537.330540:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946537.333251:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286524416 00000100:00100000:0.0:1790946537.333273:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286524416 00000100:00100000:1.0:1790946537.333675:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 39 00000100:00100000:1.0:1790946537.333715:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be979880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+10:10287:x1877943286524416:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:1.0:1790946537.333741:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946537.333778:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef93271f76 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cca5 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.333880:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93271f7d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.333916:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93271f7d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.333929:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93271f7d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.333950:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93271f84 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.333958:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93271f84 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.333966:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93271f84 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.334938:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f000/0x16e41aef93271f8b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.334954:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f000/0x16e41aef93271f8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.334963:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f000/0x16e41aef93271f8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790946537.335001:0:5836:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1790946537.335006:0:5836:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790946537.335068:0:5836:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f000/0x16e41aef93271f8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.335082:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93271f7d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.335105:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93271f7d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.335113:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93271f7d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.335120:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180f600 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:1.0:1790946537.335125:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93271f7d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.335133:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93271f7d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.335156:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9146a0a5e400) 00010000:00010000:1.0:1790946537.335160:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790946537.335166:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93271f7d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.335173:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93271f7d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.335189:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93271f84 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.335194:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93271f84 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.335444:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93271f84 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.335451:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180e600 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:1.0:1790946537.335461:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93271f84 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.335468:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93271f84 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.335477:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff91469e29d900) 00010000:00010000:1.0:1790946537.335480:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790946537.335483:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93271f84 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.335490:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93271f84 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.335538:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef93271f76 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cca5 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.335553:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f000/0x16e41aef93271f8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cca5 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.335561:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91469e29d100) 00010000:00010000:1.0:1790946537.335564:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1790946537.335567:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b180f000, rc 0) 00000100:00100000:1.0:1790946537.335669:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be979880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+11:10287:x1877943286524416:12345-192.168.203.13@tcp:101:bash.0 Request processed in 1982us (5143us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946537.335678:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 39 00000100:00100000:1.0:1790946537.339869:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946537.340544:0:11315:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286524672 00000100:00100000:2.0:1790946537.340559:0:11315:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286524672 00000100:00100000:2.0:1790946537.340661:0:11315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 40 00000100:00100000:2.0:1790946537.340673:0:11315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914688711c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+11:10287:x1877943286524672:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:2.0:1790946537.340703:0:11315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946537.340731:0:11315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef93271f92 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0ccac expref: -99 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946537.340925:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93271f99 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946537.340954:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93271f99 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946537.340967:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93271f99 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946537.345009:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef93271fa0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946537.345035:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef93271fa0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946537.345049:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef93271fa0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790946537.346363:0:11315:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:2.0:1790946537.346558:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef93271fa7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946537.346574:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef93271fa7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946537.346584:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef93271fa7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946537.347366:0:11315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93271f99 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946537.347381:0:11315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93271f99 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946537.347390:0:11315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93271f99 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946537.347396:0:11315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aee600 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:2.0:1790946537.347401:0:11315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93271f99 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946537.347408:0:11315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93271f99 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946537.347489:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91469e29d100) 00010000:00010000:2.0:1790946537.347493:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790946537.347497:0:11315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93271f99 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946537.347504:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93271f99 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790946537.347518:0:11315:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000700a8553 reply state 000000002723dce1 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef93271fa0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946537.347526:0:11315:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1790946537.347564:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef93271f92 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ccac expref: 14 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946537.347593:0:11315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef93271fa7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ccac expref: 13 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946537.347600:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9146a0a5ef00) 00010000:00010000:2.0:1790946537.347602:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790946537.347605:0:11315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914688aee400, rc 0) 00000100:00100000:2.0:1790946537.347680:0:11315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914688711c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+14:10287:x1877943286524672:12345-192.168.203.13@tcp:101:bash.0 Request processed in 7010us (7826us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1790946537.347689:0:11315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 40 00010000:00010000:2.0:1790946537.350857:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef93271fa0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946537.350875:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef93271fa0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946537.350883:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef93271fa0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946537.350890:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aeec00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:2.0:1790946537.350894:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef93271fa0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946537.350902:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef93271fa0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946537.350919:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9146a0a5ea00) 00010000:00010000:2.0:1790946537.350922:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790946537.350927:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef93271fa0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946537.350957:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef93271fa0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946537.353184:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946537.355620:0:6808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286524800 00000100:00100000:3.0:1790946537.355642:0:6808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286524800 00000100:00100000:2.0:1790946537.355821:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:2.0:1790946537.355839:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914688710700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2360:x1877943286524800:12345-192.168.203.13@tcp:8:bash.0 00010000:00080000:2.0:1790946537.355877:0:6675:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 7eed1f4b-bd5b-4a70-8045-59db065b3dfc@192.168.203.13@tcp t0 exp 0000000000000000 cur 322 last 0 00000020:00000080:2.0:1790946537.355937:0:6675:0:(genops.c:1384:class_connect()) connect: client 7eed1f4b-bd5b-4a70-8045-59db065b3dfc, cookie 0x16e41aef93271fb5 00002000:00100000:2.0:1790946537.355956:0:6675:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7eed1f4b-bd5b-4a70-8045-59db065b3dfc/ffff914684945800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b03 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790946537.355978:0:6675:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type b7, return b7 00002000:00080000:2.0:1790946537.358425:0:6675:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1790946537.358468:0:6675:0:(import.c:65:import_set_state_nolock()) ffff914684946000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790946537.358555:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914688710700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2360:x1877943286524800:12345-192.168.203.13@tcp:8:bash.0 Request processed in 2719us (5386us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946537.358567:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:3.0:1790946537.363500:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946537.363897:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286524928 00000100:00100000:0.0:1790946537.363912:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286524928 00000100:00100000:0.0:1790946537.365006:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:0.0:1790946537.365023:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be97aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:0:x1877943286524928:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:0.0:1790946537.365050:0:6673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946537.365103:0:6673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002361750e/0x16e41aef93271fbc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0ccb3 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790946537.365140:0:6673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790946537.365165:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=322s v=(0 0) 00010000:00010000:0.0:1790946537.365171:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946537.365183:0:6673:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002361750e/0x16e41aef93271fbc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ccb3 expref: 7 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946537.365230:0:6673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002361750e/0x16e41aef93271fbc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ccb3 expref: 7 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946537.365255:0:6673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146c20cac00, rc 0) 00000100:00100000:0.0:1790946537.365348:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be97aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+7:0:x1877943286524928:12345-192.168.203.13@tcp:101:bash.0 Request processed in 330us (1861us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946537.365356:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00080000:1.0:1790946537.365740:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790946537.375419:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946537.375657:0:6808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286525056 00000100:00100000:2.0:1790946537.375729:0:6808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286525056 00000100:00100000:2.0:1790946537.375990:0:6808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00100000:2.0:1790946537.376005:0:6808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be979c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+7:10287:x1877943286525056:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:2.0:1790946537.376032:0:6808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946537.376061:0:6808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008786149f/0x16e41aef93271fc3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0ccba expref: -99 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946537.376103:0:6808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002361750e/0x16e41aef93271fbc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ccb3 expref: 8 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946537.376136:0:6808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790946537.376141:0:6808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790946537.376147:0:6808:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008786149f/0x16e41aef93271fc3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ccba expref: 8 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946537.376190:0:6808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002361750e/0x16e41aef93271fbc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ccb3 expref: 8 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946537.376255:0:6808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002361750e/0x16e41aef93271fbc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ccb3 expref: 8 pid: 6673 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946537.376273:0:6808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee39f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6808:1877943303338752:192.168.203.13@tcp:104: 00000100:00100000:2.0:1790946537.376612:0:6808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146b79a5240 going to sleep for 11 seconds 00000100:00100000:3.0:1790946537.382166:0:6808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee39f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6808:1877943303338752:192.168.203.13@tcp:104: 00010000:00010000:3.0:1790946537.382277:0:6808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008786149f/0x16e41aef93271fc3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ccba expref: 8 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946537.382311:0:6808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914688aef800, rc 0) 00000100:00100000:3.0:1790946537.382396:0:6808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be979c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+8:10287:x1877943286525056:12345-192.168.203.13@tcp:101:bash.0 Request processed in 6395us (9472us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946537.382405:0:6808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00100000:0.0:1790946537.388525:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946537.388832:0:5821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286525184 00000100:00100000:2.0:1790946537.388859:0:5821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286525184 00010000:00010000:2.0:1790946537.388917:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002361750e/0x16e41aef93271fbc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ccb3 expref: 8 pid: 6673 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946537.388967:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 35 00000100:00100000:2.0:1790946537.388979:0:5821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468e93ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+8:2363:x1877943286525184:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790946537.389000:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790946537.389032:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002361750e/0x16e41aef93271fbc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ccb3 expref: 8 pid: 6673 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946537.389073:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002361750e/0x16e41aef93271fbc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ccb3 expref: 8 pid: 6673 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946537.389104:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002361750e/0x16e41aef93271fbc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ccb3 expref: 8 pid: 6673 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946537.389128:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790946537.389133:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790946537.389144:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008786149f/0x16e41aef93271fc3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ccba expref: 7 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946537.389155:0:5821:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008786149f/0x16e41aef93271fc3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ccba expref: 7 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946537.389621:0:5821:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008786149f/0x16e41aef93271fc3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ccba expref: 7 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946537.389645:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee38380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5821:1877943303338880:192.168.203.13@tcp:105: 00000100:00100000:2.0:1790946537.389793:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146b79a5540 going to sleep for 11 seconds 00000100:00100000:0.0:1790946537.395187:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee38380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5821:1877943303338880:192.168.203.13@tcp:105: 00010000:00010000:0.0:1790946537.395262:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790946537.395349:0:5821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468e93ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+7:2363:x1877943286525184:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 6370us (6838us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946537.395362:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 35 00000100:00100000:1.0:1790946537.400533:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946537.400933:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286525440 00000100:00100000:2.0:1790946537.400948:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286525440 00000100:00100000:2.0:1790946537.401020:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:2.0:1790946537.401033:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914688713100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+13:10287:x1877943286525440:12345-192.168.203.13@tcp:35:bash.0 00000001:00080000:2.0:1790946537.401487:0:5838:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967312 00000100:00100000:2.0:1790946537.402985:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914688713100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+15:10287:x1877943286525440:12345-192.168.203.13@tcp:35:bash.0 Request processed in 634us (1147us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1790946537.403011:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 6 00000020:00080000:2.0:1790946537.403022:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1790946537.507077:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946537.507517:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286525696 00000100:00100000:2.0:1790946537.507532:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286525696 00000100:00100000:2.0:1790946537.507612:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 41 00000100:00100000:2.0:1790946537.507624:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be978700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+15:10297:x1877943286525696:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1790946537.507657:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946537.507684:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef400/0x16e41aef93271fca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0ccc1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790946537.507852:0:5834:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1790946537.508026:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef400/0x16e41aef93271fca lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ccc1 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946537.508043:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9146a0a5e400) 00010000:00010000:2.0:1790946537.508046:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790946537.508052:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef400/0x16e41aef93271fca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ccc1 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946537.508765:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914688aef400, rc 0) 00000100:00100000:2.0:1790946537.509022:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be978700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+16:10297:x1877943286525696:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 1397us (1969us total) trans 4294967314 rc 301/301 00000100:00100000:2.0:1790946537.509031:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 41 00000100:00100000:3.0:1790946537.518028:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946537.518162:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286525952 00000100:00100000:2.0:1790946537.518175:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286525952 00000100:00100000:2.0:1790946537.518300:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:2.0:1790946537.518329:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be97bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+16:10297:x1877943286525952:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:2.0:1790946537.519033:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be97bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+17:10297:x1877943286525952:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 702us (1191us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1790946537.519044:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:3.0:1790946537.625630:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946537.625876:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286526080 00000100:00100000:1.0:1790946537.625889:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286526080 00000100:00100000:1.0:1790946537.625968:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 42 00000100:00100000:1.0:1790946537.625979:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be97a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+17:10303:x1877943286526080:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1790946537.626013:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946537.626040:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93271fd8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0ccc8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.626140:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93271fdf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.626158:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93271fdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.626172:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93271fdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790946537.626244:0:5836:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1790946537.626249:0:5836:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790946537.626277:0:5836:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93271fdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.626399:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93271fd8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ccc8 expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.626424:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93271fdf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ccc8 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.626434:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91469e29d100) 00010000:00010000:1.0:1790946537.626437:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790946537.626455:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b180f600, rc 0) 00000100:00100000:1.0:1790946537.626588:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be97a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+18:10303:x1877943286526080:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 610us (971us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946537.626597:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 42 00000100:00100000:3.0:1790946537.630625:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946537.631024:0:11315:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286526336 00000100:00100000:2.0:1790946537.631038:0:11315:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286526336 00000100:00100000:2.0:1790946537.632365:0:11315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 43 00000100:00100000:2.0:1790946537.632389:0:11315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be97a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+18:10303:x1877943286526336:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1790946537.632417:0:11315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946537.632445:0:11315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef400/0x16e41aef93271fe6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cccf expref: -99 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946537.632644:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef93271fed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946537.632662:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef93271fed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946537.632677:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef93271fed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790946537.632690:0:11315:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1790946537.632954:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef400/0x16e41aef93271fe6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cccf expref: 21 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946537.632977:0:11315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef93271fed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cccf expref: 20 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946537.633010:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9146a0a5ef00) 00010000:00010000:2.0:1790946537.633013:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790946537.633017:0:11315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914688aefc00, rc 0) 00000100:00100000:2.0:1790946537.633107:0:11315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be97a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+20:10303:x1877943286526336:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 729us (2496us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1790946537.633123:0:11315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 43 00000100:00100000:3.0:1790946537.639486:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946537.639540:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946537.639626:0:5820:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286526720 00000100:00100000:0.0:1790946537.639639:0:5820:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286526720 00000100:00100000:1.0:1790946537.639651:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286526592 00000100:00100000:1.0:1790946537.639658:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286526592 00000100:00100000:0.0:1790946537.639727:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 2 00000100:00100000:0.0:1790946537.639738:0:5820:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be979180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+21:2364:x1877943286526720:12345-192.168.203.13@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1790946537.639763:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 44 00000100:00100000:1.0:1790946537.639787:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be97ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+21:10303:x1877943286526592:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1790946537.639793:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790946537.639815:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946537.639828:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef93271fed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cccf expref: 21 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.639839:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93271ffb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0ccd6 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946537.639851:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9146a0a5ef00) 00010000:00010000:0.0:1790946537.639859:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790946537.640176:0:5820:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be979180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+21:2364:x1877943286526720:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 438us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946537.640185:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 2 00010000:00010000:1.0:1790946537.640404:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272002 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.640423:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272002 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.640435:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272002 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790946537.640450:0:5835:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1790946537.640623:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93271ffb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ccd6 expref: 22 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.640644:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272002 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ccd6 expref: 21 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.640653:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9146a0a5ef00) 00010000:00010000:1.0:1790946537.640667:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1790946537.640670:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b180f800, rc 0) 00000100:00100000:1.0:1790946537.640716:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be97ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+21:10303:x1877943286526592:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 931us (1245us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1790946537.640724:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 44 00000100:00100000:3.0:1790946537.653346:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946537.653554:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286526848 00000100:00100000:0.0:1790946537.653568:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286526848 00000100:00100000:0.0:1790946537.654540:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 23 00000100:00100000:0.0:1790946537.654564:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be97b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+7:2362:x1877943286526848:12345-192.168.203.13@tcp:1:lfs.0 00010000:00010000:0.0:1790946537.654631:0:6673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000267d32e3/0x16e41aef93272010 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946537.654666:0:6673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008786149f/0x16e41aef93271fc3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ccba expref: 7 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946537.654676:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946537.654681:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790946537.654687:0:6673:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000267d32e3/0x16e41aef93272010 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946537.654735:0:6673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008786149f/0x16e41aef93271fc3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ccba expref: 7 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946537.654916:0:6673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008786149f/0x16e41aef93271fc3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ccba expref: 7 pid: 6808 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946537.654937:0:6673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91468e93d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6673:1877943303339008:192.168.203.13@tcp:104: 00000100:00100000:0.0:1790946537.655532:0:6673:0:(client.c:2716:ptlrpc_set_wait()) set ffff9145868726c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790946537.662115:0:6673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91468e93d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6673:1877943303339008:192.168.203.13@tcp:104: 00010000:00010000:0.0:1790946537.662162:0:6673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000267d32e3/0x16e41aef93272010 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946537.667530:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946537.668170:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286526976 00000100:00100000:0.0:1790946537.668188:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286526976 00002000:00100000:0.0:1790946537.668313:0:6679:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9146be979f80 x1877943286526976/t0(0) o4->7eed1f4b-bd5b-4a70-8045-59db065b3dfc@192.168.203.13@tcp:478/0 lens 504/0 e 0 to 0 dl 1790946548 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790946537.668327:0:6679:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9146be979f80 with x1877943286526976 ext(0->12) 00010000:00010000:0.0:1790946537.668341:0:6679:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000008786149f/0x16e41aef93271fc3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ccba expref: 8 pid: 6808 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946537.668362:0:6679:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000008786149f/0x16e41aef93271fc3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ccba expref: 8 pid: 6808 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790946537.668377:0:6679:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9146be979f80 00000100:00100000:0.0:1790946537.668418:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:0.0:1790946537.668436:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be979f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+8:2364:x1877943286526976:12345-192.168.203.13@tcp:4:lfs.0 00000001:00100000:0.0:1790946537.735744:0:6700:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7eed1f4b-bd5b-4a70-8045-59db065b3dfc 00000100:00100000:2.0:1790946537.740695:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be979f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+9:2364:x1877943286526976:12345-192.168.203.13@tcp:4:lfs.0 Request processed in 72250us (73156us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1790946537.740724:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 0 00002000:00100000:2.0:1790946537.740754:0:6679:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9146be979f80 x1877943286526976/t4294967299(0) o4->7eed1f4b-bd5b-4a70-8045-59db065b3dfc@192.168.203.13@tcp:478/0 lens 504/448 e 0 to 0 dl 1790946548 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790946537.740773:0:6679:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9146be979f80 with x1877943286526976 ext(0->12) 00010000:00010000:2.0:1790946537.740788:0:6679:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000008786149f/0x16e41aef93271fc3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ccba expref: 9 pid: 6808 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946537.740815:0:6679:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000008786149f/0x16e41aef93271fc3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ccba expref: 9 pid: 6808 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790946537.740824:0:6679:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9146be979f80 00000100:00100000:2.0:1790946537.768285:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946537.768974:0:5821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286527104 00000100:00100000:1.0:1790946537.768994:0:5821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286527104 00010000:00010000:1.0:1790946537.769061:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008786149f/0x16e41aef93271fc3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ccba expref: 9 pid: 6808 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946537.769121:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 36 00000100:00100000:1.0:1790946537.769133:0:5821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+9:2364:x1877943286527104:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790946537.769155:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1790946537.769182:0:5821:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1790946537.769185:0:5821:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1790946537 00002000:00010000:1.0:1790946537.769187:0:5821:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1790946537 00002000:00010000:1.0:1790946537.769189:0:5821:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1790946537 00010000:00010000:1.0:1790946537.769197:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008786149f/0x16e41aef93271fc3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ccba expref: 9 pid: 6808 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.769458:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008786149f/0x16e41aef93271fc3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ccba expref: 9 pid: 6808 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.769496:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008786149f/0x16e41aef93271fc3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ccba expref: 9 pid: 6808 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.769522:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790946537.769546:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790946537.769554:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000267d32e3/0x16e41aef93272010 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.769566:0:5821:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000267d32e3/0x16e41aef93272010 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.769610:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790946537.769700:0:5821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+8:2364:x1877943286527104:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 568us (1430us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946537.769709:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 36 00010000:00010000:3.0:1790946537.773619:0:6673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000267d32e3/0x16e41aef93272010 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946537.774025:0:6673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000267d32e3/0x16e41aef93272010 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946537.774084:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000267d32e3/0x16e41aef93272010 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946537.774094:0:6673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000267d32e3/0x16e41aef93272010 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946537.774104:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000267d32e3/0x16e41aef93272010 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946537.774111:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146c20cb600 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:3.0:1790946537.774117:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000267d32e3/0x16e41aef93272010 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946537.774159:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000267d32e3/0x16e41aef93272010 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946537.774188:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000267d32e3/0x16e41aef93272010 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946537.774196:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000267d32e3/0x16e41aef93272010 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946537.775557:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be97b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+7:2362:x1877943286526848:12345-192.168.203.13@tcp:1:lfs.0 Request processed in 120098us (121323us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946537.775572:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 23 00010000:00010000:0.0:1790946537.779334:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946537.797147:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946537.797461:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286527360 00000100:00100000:0.0:1790946537.797477:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286527360 00000100:00100000:0.0:1790946537.797562:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:0.0:1790946537.797574:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be979500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+21:10303:x1877943286527360:12345-192.168.203.13@tcp:35:lfs.0 00000004:00010000:0.0:1790946537.797670:0:5837:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272002 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ccd6 expref: 21 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790946537.798118:0:5837:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1790946537.798167:0:5837:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:1.0:1790946537.804706:0:5837:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967320 00010000:00010000:1.0:1790946537.804851:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272017 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.804878:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef93271fa7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ccac expref: 25 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.805159:0:5837:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272017 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.805720:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef93271fa7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ccac expref: 25 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.805742:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef93271fa7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ccac expref: 25 pid: 11315 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946537.805829:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914688710380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5837:1877943303339136:192.168.203.13@tcp:104: 00000100:00100000:1.0:1790946537.806162:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146a0379780 going to sleep for 11 seconds 00000100:00100000:1.0:1790946537.811645:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914688710380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5837:1877943303339136:192.168.203.13@tcp:104: 00010000:00010000:1.0:1790946537.811698:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272017 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946537.813535:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946537.819221:0:5820:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286527488 00000100:00100000:0.0:1790946537.819246:0:5820:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286527488 00010000:00010000:0.0:1790946537.819321:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef93271fa7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ccac expref: 26 pid: 11315 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946537.819373:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 37 00000100:00100000:0.0:1790946537.819383:0:5820:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be978380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+26:2364:x1877943286527488:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790946537.819404:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790946537.819484:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef93271fa7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ccac expref: 26 pid: 11315 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946537.819501:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef93271fa7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ccac expref: 26 pid: 11315 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946537.819530:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef93271fa7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ccac expref: 26 pid: 11315 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946537.819580:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9146a0a5ef00) 00010000:00010000:0.0:1790946537.819587:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272017 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946537.819598:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272017 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946537.819606:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272017 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946537.819647:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790946537.819740:0:5820:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be978380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+25:2364:x1877943286527488:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 358us (6217us total) trans 0 rc 0/0 00010000:00010000:1.0:1790946537.819746:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272017 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946537.819748:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 37 00010000:00010000:1.0:1790946537.819755:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272017 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790946537.820114:0:5837:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967321 00000001:00080000:1.0:1790946537.820614:0:5837:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:1.0:1790946537.822088:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914688710380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5837:1877943303339264:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1790946537.822754:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946537.822878:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146a0379840 going to sleep for 11 seconds 00000100:00100000:0.0:1790946537.823717:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303339264 00000100:00100000:0.0:1790946537.823732:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303339264 00000100:00100000:0.0:1790946537.823817:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790946537.823828:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914688710000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5837:x1877943303339264:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1790946537.824122:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914688710000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5837:x1877943303339264:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 295us (1369us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946537.824131:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790946537.824458:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914688710380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5837:1877943303339264:0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:1.0:1790946537.826354:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1790946537.828137:0:5837:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:2.0:1790946537.830107:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee3aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5837:1877943303339392:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1790946537.830510:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946537.830559:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff91469814a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790946537.830669:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303339392 00000100:00100000:0.0:1790946537.830680:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303339392 00000100:00100000:0.0:1790946537.830740:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790946537.830750:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5837:x1877943303339392:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1790946537.831089:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5837:x1877943303339392:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 339us (580us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1790946537.831109:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790946537.832567:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee3aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5837:1877943303339392:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1790946537.832710:0:5837:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1790946537.833679:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272017 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946537.833696:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272017 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946537.833705:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272017 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946537.833711:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180e600 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:2.0:1790946537.833717:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272017 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946537.833725:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272017 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946537.833744:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9146a0a5ef00) 00010000:00010000:2.0:1790946537.833748:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1790946537.833753:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272017 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946537.834192:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272017 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790946537.835104:0:5837:0:(mdd_object.c:4180:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1790946537.836162:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1790946537.836524:0:5837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 322908322095ns, next at 323908317855ns, rc = 0 00000001:00080000:2.0:1790946537.836559:0:5837:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:2.0:1790946537.836640:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9146a0a5ef00) 00010000:00010000:2.0:1790946537.836644:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1790946537.836740:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272002 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ccd6 expref: 29 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946537.837107:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be979500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+28:10303:x1877943286527360:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 39533us (39975us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1790946537.837119:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 8 00000020:00080000:2.0:1790946537.837126:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1790946537.848049:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946537.850274:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286527616 00000100:00100000:1.0:1790946537.850296:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286527616 00000100:00100000:1.0:1790946537.850386:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 45 00000100:00100000:1.0:1790946537.850400:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+28:10303:x1877943286527616:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1790946537.850434:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946537.850466:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef9327201e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0ccdd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.850549:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef9327201e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ccdd expref: 29 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.850565:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef9327201e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ccdd expref: 29 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.850610:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91469e29d900) 00010000:00010000:1.0:1790946537.850613:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790946537.850618:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b180fc00, rc 0) 00000100:00100000:1.0:1790946537.850716:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+29:10303:x1877943286527616:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 320us (2684us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946537.850724:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 45 00000100:00100000:0.0:1790946537.854783:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946537.854902:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286527872 00000100:00100000:1.0:1790946537.854918:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286527872 00000100:00100000:1.0:1790946537.854990:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:1.0:1790946537.855002:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b2653850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+29:10303:x1877943286527872:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:0.0:1790946537.855928:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b2653850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+30:10303:x1877943286527872:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 920us (1168us total) trans 4294967327 rc 0/0 00000100:00100000:0.0:1790946537.855940:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:2.0:1790946537.959967:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946537.960076:0:11315:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286528128 00000100:00100000:0.0:1790946537.960088:0:11315:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286528128 00000100:00100000:0.0:1790946537.960151:0:11315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 46 00000100:00100000:0.0:1790946537.960159:0:11315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+30:10313:x1877943286528128:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1790946537.960191:0:11315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946537.960265:0:11315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cac00/0x16e41aef93272025 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cce4 expref: -99 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790946537.960384:0:11315:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1790946537.960560:0:11315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cac00/0x16e41aef93272025 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cce4 expref: 32 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946537.960576:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9146a0a5e400) 00010000:00010000:0.0:1790946537.960579:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790946537.960585:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cac00/0x16e41aef93272025 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cce4 expref: 32 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946537.960605:0:11315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146c20cac00, rc 0) 00000100:00100000:0.0:1790946537.960696:0:11315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+31:10313:x1877943286528128:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 535us (741us total) trans 4294967328 rc 301/301 00000100:00100000:0.0:1790946537.960704:0:11315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 46 00000100:00100000:2.0:1790946537.967184:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946537.970908:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286528256 00000100:00100000:1.0:1790946537.971161:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286528256 00000100:00100000:1.0:1790946537.971564:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 47 00000100:00100000:1.0:1790946537.971580:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+31:10313:x1877943286528256:12345-192.168.203.13@tcp:34:lfs.0 00010000:00010000:1.0:1790946537.971694:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272033 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.971716:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272033 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.971732:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272033 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.971749:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef9327203a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.971830:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef9327203a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.971863:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef9327203a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.972044:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef93272041 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.972053:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef93272041 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.972059:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef93272041 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790946537.972116:0:5835:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef93272041 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.972132:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272033 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.972140:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272033 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.972148:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272033 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.972155:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180f800 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:1.0:1790946537.972160:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272033 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.972169:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272033 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.972191:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91469e29d100) 00010000:00010000:1.0:1790946537.972421:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790946537.972430:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272033 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.972437:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272033 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.972454:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef9327203a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.972459:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef9327203a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.972465:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef9327203a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.972470:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180e600 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:1.0:1790946537.972473:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef9327203a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.972478:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef9327203a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.972486:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91469e29dd00) 00010000:00010000:1.0:1790946537.972488:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790946537.972491:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef9327203a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.972496:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef9327203a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.972520:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef93272041 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.972531:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef93272041 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.972536:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef93272041 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.972541:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180ee00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:1.0:1790946537.972543:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef93272041 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.972549:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef93272041 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.972556:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91469e29d900) 00010000:00010000:1.0:1790946537.972558:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790946537.972560:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef93272041 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946537.972565:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef93272041 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946537.972741:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+31:10313:x1877943286528256:12345-192.168.203.13@tcp:34:lfs.0 Request processed in 1160us (5567us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946537.972752:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 47 00000100:00100000:3.0:1790946537.976847:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946537.976935:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286528512 00000100:00100000:2.0:1790946537.976949:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286528512 00000100:00100000:2.0:1790946537.977026:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:2.0:1790946537.977039:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be97bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+31:10313:x1877943286528512:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:2.0:1790946537.977396:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be97bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+32:10313:x1877943286528512:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 358us (1233us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1790946537.977403:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:2.0:1790946538.020622:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946538.020790:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286528768 00000100:00100000:1.0:1790946538.020806:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286528768 00000100:00100000:1.0:1790946538.020906:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 48 00000100:00100000:1.0:1790946538.020918:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+32:10316:x1877943286528768:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1790946538.021119:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946538.021164:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef93272048 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cceb expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946538.021412:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef9327204f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946538.021494:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef9327204f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946538.021508:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef9327204f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946538.021522:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272056 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946538.021527:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272056 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946538.021531:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272056 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946538.022620:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327205d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946538.022642:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327205d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946538.023564:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327205d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790946538.023586:0:5836:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1790946538.024190:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef9327204f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946538.024754:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef9327204f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946538.024763:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef9327204f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946538.024780:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180e600 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:1.0:1790946538.024786:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef9327204f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946538.024795:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef9327204f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946538.024812:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91469e29d100) 00010000:00010000:1.0:1790946538.024815:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790946538.024821:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef9327204f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946538.024828:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef9327204f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946538.025586:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272056 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946538.025600:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272056 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946538.025608:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272056 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946538.025615:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180f800 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:1.0:1790946538.025631:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272056 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946538.025638:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272056 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946538.025726:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91469e29dd00) 00010000:00010000:1.0:1790946538.025731:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790946538.025736:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272056 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946538.025744:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272056 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946538.026367:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef93272048 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cceb expref: 35 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946538.026393:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327205d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cceb expref: 34 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946538.026401:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91469e29d900) 00010000:00010000:1.0:1790946538.026404:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790946538.026407:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b180fa00, rc 0) 00000100:00100000:1.0:1790946538.027073:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+34:10316:x1877943286528768:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 6152us (6461us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1790946538.027085:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 48 00000100:00100000:3.0:1790946538.033437:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946538.034399:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286528896 00000100:00100000:0.0:1790946538.034417:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286528896 00000100:00100000:0.0:1790946538.034599:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 49 00000100:00100000:0.0:1790946538.034610:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be979500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+34:10316:x1877943286528896:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:0.0:1790946538.035406:0:6803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cac00/0x16e41aef9327206b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946538.035440:0:6803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cac00/0x16e41aef9327206b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946538.035455:0:6803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cac00/0x16e41aef9327206b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946538.035493:0:6803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cac00/0x16e41aef9327206b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946538.035502:0:6803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cac00/0x16e41aef9327206b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946538.035511:0:6803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cac00/0x16e41aef9327206b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946538.035518:0:6803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146c20cac00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:0.0:1790946538.035523:0:6803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cac00/0x16e41aef9327206b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946538.035531:0:6803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cac00/0x16e41aef9327206b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946538.035545:0:6803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91469e29d900) 00010000:00010000:0.0:1790946538.035549:0:6803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790946538.035554:0:6803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cac00/0x16e41aef9327206b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946538.035581:0:6803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cac00/0x16e41aef9327206b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946538.036532:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be979500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+34:10316:x1877943286528896:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 1911us (4100us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946538.036549:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 49 00000100:00100000:3.0:1790946538.059718:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946538.060539:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286529152 00000100:00100000:2.0:1790946538.060564:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286529152 00000100:00100000:2.0:1790946538.060640:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:2.0:1790946538.060660:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146becb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+34:10316:x1877943286529152:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:2.0:1790946538.062569:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146becb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+35:10316:x1877943286529152:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 1905us (2851us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1790946538.062612:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:2.0:1790946538.210946:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946538.211012:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946538.211163:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286529280 00000100:00100000:3.0:1790946538.211190:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286529280 00000100:00100000:3.0:1790946538.211312:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 288 00000100:00100000:3.0:1790946538.211323:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:2362:x1877943286529280:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790946538.211426:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:2362:x1877943286529280:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 104us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946538.211434:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 288 00000100:00100000:0.0:1790946538.212141:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286529408 00000100:00100000:0.0:1790946538.212151:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286529408 00000100:00100000:0.0:1790946538.212278:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 132 00000100:00100000:0.0:1790946538.212290:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+5:2362:x1877943286529408:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1790946538.212359:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+5:2362:x1877943286529408:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 72us (1428us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946538.212366:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 132 00000100:00080000:1.0:1790946538.212447:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790946538.480458:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914688713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3302:1877943303339520:0@lo:400:kworker.0 00000100:00100000:1.0:1790946538.480517:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914688711f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1877943303339776:0@lo:400:kworker.0 00000100:00100000:2.0:1790946538.480630:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914688711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877943303339648:0@lo:400:kworker.0 00000100:00100000:1.0:1790946538.480711:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946538.480941:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790946538.480949:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914688710a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303339904:0@lo:400:kworker.0 00000100:00100000:1.0:1790946538.480985:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946538.481027:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303339776 00000100:00100000:1.0:1790946538.481037:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303339776 00000100:00100000:1.0:1790946538.481105:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1790946538.481116:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914688713100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1877943303339776:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1790946538.481404:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790946538.481447:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303339904 00000100:00100000:0.0:1790946538.481452:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303339904 00000100:00100000:0.0:1790946538.481489:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1790946538.481497:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914688710380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3300:x1877943303339904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946538.481565:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914688710380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3300:x1877943303339904:12345-0@lo:400:kworker.0 Request processed in 68us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946538.481573:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1790946538.484485:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914688713100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1877943303339776:12345-0@lo:400:kworker.0 Request processed in 3355us (3759us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946538.484503:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1790946538.484597:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914688710a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303339904:0@lo:400:kworker.0 00000100:00100000:1.0:1790946538.484616:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914688711f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1877943303339776:0@lo:400:kworker.0 00000100:00100000:2.0:1790946538.489262:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946538.489327:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303339648 00000100:00100000:2.0:1790946538.489341:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303339648 00000100:00100000:2.0:1790946538.489409:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1790946538.489422:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877943303339648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946538.489492:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877943303339648:12345-0@lo:400:kworker.0 Request processed in 73us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946538.489500:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1790946538.489570:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914688711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877943303339648:0@lo:400:kworker.0 00000100:00100000:2.0:1790946538.489586:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914688712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303340160:0@lo:400:kworker.0 00000100:00100000:2.0:1790946538.489620:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946538.489665:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790946538.489674:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914688713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1877943303340032:0@lo:400:kworker.0 00000100:00100000:2.0:1790946538.489702:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946538.489728:0:11315:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303340032 00000100:00100000:2.0:1790946538.489732:0:11315:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303340032 00000100:00100000:2.0:1790946538.489785:0:11315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1790946538.489792:0:11315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877943303340032:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1790946538.489819:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790946538.489829:0:11315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877943303340032:12345-0@lo:400:kworker.0 Request processed in 38us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946538.489835:0:11315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1790946538.489884:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914688713800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1877943303340032:0@lo:400:kworker.0 00000100:00100000:1.0:1790946538.489907:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303340160 00000100:00100000:1.0:1790946538.489913:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303340160 00000100:00100000:1.0:1790946538.489960:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790946538.489969:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1877943303340160:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1790946538.490141:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790946538.490245:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1877943303340160:12345-0@lo:400:kworker.0 Request processed in 278us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946538.490254:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790946538.491964:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946538.492019:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303339520 00000100:00100000:0.0:1790946538.492032:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303339520 00000100:00100000:0.0:1790946538.492083:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1790946538.492094:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3302:x1877943303339520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946538.492182:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3302:x1877943303339520:12345-0@lo:400:kworker.0 Request processed in 90us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946538.492190:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1790946538.492248:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914688713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3302:1877943303339520:0@lo:400:kworker.0 00000100:00100000:2.0:1790946538.496397:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914688712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303340160:0@lo:400:kworker.0 00000100:00100000:3.0:1790946538.513854:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946538.513988:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286529664 00000100:00100000:1.0:1790946538.514003:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286529664 00000100:00100000:1.0:1790946538.514085:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 50 00000100:00100000:1.0:1790946538.514096:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146becb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+35:10347:x1877943286529664:12345-192.168.203.13@tcp:101:cat.0 00010000:00010000:1.0:1790946538.514130:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946538.514158:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef93272072 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0ccf2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946538.514322:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272079 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946538.514364:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272079 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946538.514378:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272079 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790946538.514393:0:5836:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1790946538.514733:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef93272072 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ccf2 expref: 38 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946538.514757:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272079 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ccf2 expref: 37 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946538.514778:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91469e29d900) 00010000:00010000:1.0:1790946538.514781:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790946538.514785:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b180f800, rc 0) 00000100:00100000:1.0:1790946538.514870:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146becb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+37:10347:x1877943286529664:12345-192.168.203.13@tcp:101:cat.0 Request processed in 775us (1032us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1790946538.514877:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 50 00000100:00100000:3.0:1790946538.529915:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946538.532665:0:5819:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286529792 00000100:00100000:0.0:1790946538.532688:0:5819:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286529792 00000100:00100000:0.0:1790946538.532794:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 3 00000100:00100000:0.0:1790946538.532806:0:5819:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914685710050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+37:2364:x1877943286529792:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790946538.532828:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790946538.532861:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272079 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ccf2 expref: 37 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946538.532885:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91469e29d900) 00010000:00010000:0.0:1790946538.532890:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790946538.532974:0:5819:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914685710050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+36:2364:x1877943286529792:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 170us (3076us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946538.532982:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 3 00000100:00100000:3.0:1790946538.534115:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946538.534197:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286530048 00000100:00100000:0.0:1790946538.534234:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286530048 00000100:00100000:0.0:1790946538.534283:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:0.0:1790946538.534292:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146becb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+36:10347:x1877943286530048:12345-192.168.203.13@tcp:35:cat.0 00000100:00100000:0.0:1790946538.534628:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146becb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+37:10347:x1877943286530048:12345-192.168.203.13@tcp:35:cat.0 Request processed in 336us (518us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1790946538.534658:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 12 00000001:00080000:1.0:1790946538.571258:0:5857:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967328 is committed 00000001:00080000:1.0:1790946538.571292:0:5857:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967330 is committed 00000001:00080000:1.0:1790946538.571313:0:5857:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967331 is committed 00000004:00080000:1.0:1790946538.571323:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:1.0:1790946538.571350:0:5857:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91469814a780 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1790946538.571356:0:5857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9146b5a0b500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91469814ac00 00000020:00080000:1.0:1790946538.571359:0:5857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9146b5a0b900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9146aa75b400 00000020:00080000:2.0:1790946538.571806:0:5868:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1790946538.571927:0:5868:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1790946538.571980:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790946538.572006:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303340288:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1790946538.572098:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946538.572343:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303340288 00000100:00100000:2.0:1790946538.572353:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303340288 00000100:00100000:2.0:1790946538.572416:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790946538.572427:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468e93ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3301:x1877943303340288:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1790946538.572462:0:6675:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1790946538.572506:0:6675:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6abface9, atime: 0x6abface9, ctime: 0x6abface9, blocks: 0x1 00010000:00010000:2.0:1790946538.572517:0:6675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008786149f/0x16e41aef93272087 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946538.572540:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=323s v=(0 0) 00010000:00010000:2.0:1790946538.572544:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790946538.572552:0:6675:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008786149f/0x16e41aef93272087 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946538.572571:0:6675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008786149f/0x16e41aef93272087 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946538.572582:0:6675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008786149f/0x16e41aef93272087 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946538.572591:0:6675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008786149f/0x16e41aef93272087 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946538.572652:0:6675:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1790946538.573301:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468e93ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3301:x1877943303340288:12345-0@lo:6:osp-syn-0-0.0 Request processed in 873us (1200us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1790946538.573312:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:2.0:1790946538.573381:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9146c1cf8000/2, rc 0, transno 4294967301 00000100:00100000:2.0:1790946538.573389:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303340288:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1790946538.573471:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790946538.573480:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008786149f/0x16e41aef93272087 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946538.573492:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aef800 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:0.0:1790946538.573497:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008786149f/0x16e41aef93272087 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946538.573509:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008786149f/0x16e41aef93272087 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946538.573533:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008786149f/0x16e41aef93272087 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946538.573540:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008786149f/0x16e41aef93272087 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946538.573563:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946538.573565:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946538.573567:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946538.614784:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946538.615279:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286530304 00000100:00100000:2.0:1790946538.615292:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286530304 00000100:00100000:2.0:1790946538.615371:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 51 00000100:00100000:2.0:1790946538.615383:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146becb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+14:10353:x1877943286530304:12345-192.168.203.13@tcp:101:dd.0 00010000:00010000:2.0:1790946538.615537:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946538.615543:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1790946538.615582:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93271fdf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ccc8 expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946538.615799:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91469e29d100) 00010000:00010000:2.0:1790946538.615805:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790946538.615827:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef9327208e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0ccf9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946538.615956:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef400/0x16e41aef93272095 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946538.615974:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327205d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cceb expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946538.616008:0:5834:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef400/0x16e41aef93272095 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946538.616063:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327205d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cceb expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946538.616198:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327205d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cceb expref: 14 pid: 5836 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946538.616286:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5eb1180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5834:1877943303340416:192.168.203.13@tcp:104: 00000100:00100000:1.0:1790946538.617436:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146b79a5540 going to sleep for 11 seconds 00000100:00100000:1.0:1790946538.619900:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5eb1180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5834:1877943303340416:192.168.203.13@tcp:104: 00010000:00010000:1.0:1790946538.619940:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef400/0x16e41aef93272095 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946538.620559:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946538.620732:0:5820:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286530432 00000100:00100000:0.0:1790946538.620742:0:5820:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286530432 00010000:00010000:0.0:1790946538.620822:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327205d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cceb expref: 15 pid: 5836 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946538.620907:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 38 00000100:00100000:0.0:1790946538.620916:0:5820:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91469829c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+15:2364:x1877943286530432:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790946538.620935:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790946538.620951:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327205d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cceb expref: 15 pid: 5836 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946538.620968:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327205d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cceb expref: 15 pid: 5836 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946538.620993:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327205d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cceb expref: 15 pid: 5836 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946538.621015:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91469e29d900) 00010000:00010000:0.0:1790946538.621021:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef400/0x16e41aef93272095 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946538.621031:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef400/0x16e41aef93272095 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946538.621038:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef400/0x16e41aef93272095 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946538.621072:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790946538.621150:0:5820:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91469829c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+14:2364:x1877943286530432:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 233us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946538.621162:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 38 00010000:00010000:1.0:1790946538.621373:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef400/0x16e41aef93272095 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946538.621383:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef400/0x16e41aef93272095 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790946538.621407:0:5834:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1790946538.621660:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef9327208e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ccf9 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946538.621680:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef400/0x16e41aef93272095 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ccf9 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946538.621689:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91469e29d900) 00010000:00010000:1.0:1790946538.621693:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790946538.621696:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914688aef400, rc 0) 00000100:00100000:1.0:1790946538.621751:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146becb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+14:10353:x1877943286530304:12345-192.168.203.13@tcp:101:dd.0 Request processed in 6370us (6994us total) trans 4294967334 rc 0/0 00000100:00100000:1.0:1790946538.621768:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 51 00000100:00100000:3.0:1790946538.624423:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946538.624518:0:11315:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286530688 00000100:00100000:2.0:1790946538.624531:0:11315:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286530688 00000100:00100000:2.0:1790946538.624599:0:11315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 52 00000100:00100000:2.0:1790946538.624607:0:11315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91469829f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+14:10353:x1877943286530688:12345-192.168.203.13@tcp:36:dd.0 00010000:00010000:2.0:1790946538.625084:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef932720a3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946538.625108:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef932720a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946538.625121:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef932720a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790946538.625171:0:11315:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967335 00000004:00010000:2.0:1790946538.625190:0:11315:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000080d58a22 reply state 00000000f980ff44 transno 4294967336 ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef932720a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946538.625197:0:11315:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790946538.625749:0:11315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91469829f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+17:10353:x1877943286530688:12345-192.168.203.13@tcp:36:dd.0 Request processed in 1135us (1334us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1790946538.625758:0:11315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 52 00000020:00080000:3.0:1790946538.625775:0:11315:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790946538.627245:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef932720a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946538.627261:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef932720a3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946538.627268:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef932720a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946538.627273:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aefc00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:0.0:1790946538.627277:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef932720a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946538.627283:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef932720a3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946538.627300:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91469e29d900) 00010000:00010000:0.0:1790946538.627303:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790946538.627309:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef932720a3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946538.627316:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef932720a3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946538.794809:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946538.795792:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286530816 00000100:00100000:2.0:1790946538.795809:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286530816 00000100:00100000:2.0:1790946538.795910:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 53 00000100:00100000:2.0:1790946538.795922:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91469829c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+16:10368:x1877943286530816:12345-192.168.203.13@tcp:101:stat.0 00010000:00010000:2.0:1790946538.795966:0:6803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946538.796402:0:6803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef932720aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cd00 expref: -99 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946538.796511:0:6803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef932720b1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946538.796530:0:6803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef932720b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946538.796543:0:6803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef932720b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946538.796559:0:6803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef932720b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946538.796566:0:6803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef932720b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946538.796573:0:6803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef932720b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946538.797712:0:6803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef932720bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946538.797736:0:6803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef400/0x16e41aef93272095 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ccf9 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946538.797779:0:6803:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef932720bf lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946538.797829:0:6803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef400/0x16e41aef93272095 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ccf9 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946538.797848:0:6803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef400/0x16e41aef93272095 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ccf9 expref: 17 pid: 5834 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946538.798393:0:6803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5eb0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6803:1877943303340544:192.168.203.13@tcp:104: 00000100:00100000:2.0:1790946538.800388:0:6803:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146b79a5240 going to sleep for 11 seconds 00010000:00010000:0.0:1790946538.800532:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946538.801262:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946538.801328:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286531072 00000100:00100000:1.0:1790946538.801340:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286531072 00000100:00100000:1.0:1790946538.801410:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:1.0:1790946538.801435:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91469829c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+18:5600:x1877943286531072:12345-192.168.203.13@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1790946538.801546:0:6803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5eb0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6803:1877943303340544:192.168.203.13@tcp:104: 00010000:00010000:0.0:1790946538.801575:0:6803:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef932720bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946538.804641:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91469829c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+19:5600:x1877943286531072:12345-192.168.203.13@tcp:35:ldlm_bl.0 Request processed in 3193us (3368us total) trans 4294967337 rc 0/0 00000100:00100000:1.0:1790946538.804678:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:3.0:1790946538.807693:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946538.808009:0:5821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286531200 00000100:00100000:1.0:1790946538.808023:0:5821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286531200 00010000:00010000:1.0:1790946538.808080:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef400/0x16e41aef93272095 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ccf9 expref: 19 pid: 5834 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946538.808266:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 39 00000100:00100000:1.0:1790946538.808278:0:5821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91469829f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+19:2364:x1877943286531200:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790946538.808300:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790946538.808309:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef400/0x16e41aef93272095 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ccf9 expref: 19 pid: 5834 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946538.808325:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef400/0x16e41aef93272095 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ccf9 expref: 19 pid: 5834 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946538.808355:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef400/0x16e41aef93272095 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ccf9 expref: 19 pid: 5834 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946538.808375:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91469e29d900) 00010000:00010000:1.0:1790946538.808381:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef932720bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946538.808392:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef932720bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946538.808401:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef932720bf lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946538.810239:0:6803:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef932720bf lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946538.810255:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790946538.810284:0:6803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef932720bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790946538.810350:0:6803:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1790946538.810355:0:6803:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790946538.810410:0:6803:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef932720bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946538.810428:0:6803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef932720bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946538.810441:0:6803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef932720b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946538.810450:0:6803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef932720b1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946538.810459:0:6803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef932720b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946538.810467:0:6803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aefc00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:0.0:1790946538.810472:0:6803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef932720b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946538.810481:0:6803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef932720b1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946538.810496:0:6803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91469e29d100) 00010000:00010000:0.0:1790946538.810500:0:6803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790946538.810505:0:6803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef932720b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946538.810521:0:6803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef932720b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946538.810537:0:6803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef932720b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946538.810543:0:6803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef932720b8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946538.810549:0:6803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef932720b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946538.810554:0:6803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aef200 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:0.0:1790946538.810558:0:6803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef932720b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946538.810564:0:6803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef932720b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946538.810572:0:5821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91469829f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+18:2364:x1877943286531200:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 2290us (2888us total) trans 0 rc 0/0 00010000:00010000:0.0:1790946538.810576:0:6803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9146a0a5e000) 00010000:00010000:0.0:1790946538.810583:0:6803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790946538.810586:0:6803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef932720b8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946538.810592:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 39 00010000:00010000:0.0:1790946538.810596:0:6803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef932720b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946538.810648:0:6803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef932720aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd00 expref: 18 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946538.810665:0:6803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef932720bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd00 expref: 17 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946538.810678:0:6803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91469e29d900) 00010000:00010000:0.0:1790946538.810681:0:6803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790946538.810683:0:6803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914688aee600, rc 0) 00000100:00100000:0.0:1790946538.810716:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91469829c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+17:10368:x1877943286530816:12345-192.168.203.13@tcp:101:stat.0 Request processed in 14796us (15922us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946538.810724:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 53 00000100:00100000:3.0:1790946538.916380:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946538.916574:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286531456 00000100:00100000:1.0:1790946538.916589:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286531456 00000100:00100000:1.0:1790946538.916676:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 54 00000100:00100000:1.0:1790946538.916689:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91469829d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+17:10374:x1877943286531456:12345-192.168.203.13@tcp:36:truncate.0 00010000:00010000:1.0:1790946538.916779:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790946538.916825:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef932720bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd00 expref: 17 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946538.916852:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91469e29d900) 00010000:00010000:1.0:1790946538.916858:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790946538.917146:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef932720c6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946538.917163:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef932720c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946538.917175:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef932720c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790946538.917295:0:5834:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967338 00000004:00010000:1.0:1790946538.917326:0:5834:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000001c21c3b4 reply state 000000003d1637b2 transno 4294967339 ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef932720c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946538.917337:0:5834:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790946538.917742:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91469829d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+19:10374:x1877943286531456:12345-192.168.203.13@tcp:36:truncate.0 Request processed in 1055us (1376us total) trans 4294967339 rc 0/0 00000100:00100000:1.0:1790946538.917752:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 54 00000020:00080000:1.0:1790946538.917767:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790946538.920732:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef932720c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946538.920754:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef932720c6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946538.920774:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef932720c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946538.920781:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180ee00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:2.0:1790946538.920787:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef932720c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946538.920796:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef932720c6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946538.920824:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91469e29d900) 00010000:00010000:2.0:1790946538.920828:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790946538.920852:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef932720c6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946538.920859:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef932720c6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946538.994175:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914688711f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303340672:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790946538.994322:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946538.994498:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303340672 00000100:00100000:0.0:1790946538.994509:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303340672 00000100:00100000:0.0:1790946538.994584:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1790946538.994595:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5eb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1877943303340672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790946538.994647:0:6678:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790946538.994715:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5eb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1877943303340672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946538.994723:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1790946538.994877:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914688711f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303340672:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790946539.097403:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946539.097637:0:11315:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286531584 00000100:00100000:2.0:1790946539.097650:0:11315:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286531584 00000100:00100000:2.0:1790946539.097775:0:11315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 55 00000100:00100000:2.0:1790946539.097790:0:11315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91469829df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+18:10388:x1877943286531584:12345-192.168.203.13@tcp:101:stat.0 00010000:00010000:2.0:1790946539.097827:0:11315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946539.097870:0:11315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef932720cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cd07 expref: -99 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.097965:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefa00/0x16e41aef932720d4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.097984:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefa00/0x16e41aef932720d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.098000:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefa00/0x16e41aef932720d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.098017:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef932720db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.098024:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef932720db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.098052:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef932720db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.098480:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef932720e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.098491:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef932720e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.098499:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef932720e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1790946539.098631:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:2.0:1790946539.099248:0:11315:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1790946539.099255:0:11315:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790946539.099294:0:11315:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef932720e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.099311:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef932720e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.099322:0:11315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefa00/0x16e41aef932720d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.099330:0:11315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefa00/0x16e41aef932720d4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.099338:0:11315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefa00/0x16e41aef932720d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.099344:0:11315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aefa00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:2.0:1790946539.099349:0:11315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefa00/0x16e41aef932720d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.099370:0:11315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefa00/0x16e41aef932720d4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.099386:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91469e29d100) 00010000:00010000:2.0:1790946539.099390:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790946539.099395:0:11315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefa00/0x16e41aef932720d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.099402:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefa00/0x16e41aef932720d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.099420:0:11315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef932720db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.099426:0:11315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef932720db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.099431:0:11315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef932720db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.099436:0:11315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aee400 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:2.0:1790946539.099439:0:11315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef932720db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.099445:0:11315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef932720db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.099453:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9146a0a5e500) 00010000:00010000:2.0:1790946539.099456:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790946539.099459:0:11315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef932720db lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.099475:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef932720db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.100332:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef932720cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd07 expref: 20 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.100364:0:11315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef932720e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd07 expref: 19 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.100374:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91469e29d900) 00010000:00010000:2.0:1790946539.100377:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790946539.100380:0:11315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914688aee000, rc 0) 00000100:00100000:2.0:1790946539.100490:0:11315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91469829df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+19:10388:x1877943286531584:12345-192.168.203.13@tcp:101:stat.0 Request processed in 2703us (3102us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946539.100500:0:11315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 55 00000100:00100000:3.0:1790946539.193162:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946539.193372:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286531840 00000100:00100000:0.0:1790946539.193386:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286531840 00000100:00100000:0.0:1790946539.193499:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 56 00000100:00100000:0.0:1790946539.193512:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91469829ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+19:10398:x1877943286531840:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1790946539.193543:0:6803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946539.193568:0:6803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cac00/0x16e41aef932720e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cd0e expref: -99 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790946539.193688:0:6803:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1790946539.193859:0:6803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cac00/0x16e41aef932720e9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd0e expref: 21 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946539.193891:0:6803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9146a0a5e400) 00010000:00010000:0.0:1790946539.193894:0:6803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790946539.193899:0:6803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cac00/0x16e41aef932720e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd0e expref: 21 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946539.193913:0:6803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146c20cac00, rc 0) 00000100:00100000:0.0:1790946539.193977:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91469829ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+20:10398:x1877943286531840:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 468us (825us total) trans 4294967340 rc 301/301 00000100:00100000:0.0:1790946539.193985:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 56 00000100:00100000:3.0:1790946539.196798:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946539.197035:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286532096 00000100:00100000:2.0:1790946539.197050:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286532096 00000100:00100000:2.0:1790946539.197135:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:2.0:1790946539.197147:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91469829f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+20:10398:x1877943286532096:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:2.0:1790946539.197939:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91469829f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+21:10398:x1877943286532096:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 789us (1150us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1790946539.197950:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:3.0:1790946539.276934:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946539.282654:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286532352 00000100:00100000:1.0:1790946539.282675:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286532352 00000100:00100000:1.0:1790946539.283456:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 57 00000100:00100000:1.0:1790946539.283472:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91469829e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+21:10404:x1877943286532352:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:1.0:1790946539.283509:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946539.283537:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef932720f7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cd15 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946539.283673:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef932720fe lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946539.283692:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef932720e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd07 expref: 22 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946539.283703:0:5834:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef932720fe lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946539.283769:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef932720e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd07 expref: 22 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946539.283786:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef932720e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd07 expref: 22 pid: 11315 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946539.283803:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914688710a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5834:1877943303340800:192.168.203.13@tcp:104: 00000100:00100000:1.0:1790946539.283953:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146a03799c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790946539.290514:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946539.292032:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914688710a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5834:1877943303340800:192.168.203.13@tcp:104: 00010000:00010000:1.0:1790946539.292069:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef932720fe lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946539.292240:0:5820:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286532480 00000100:00100000:0.0:1790946539.292250:0:5820:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286532480 00010000:00010000:0.0:1790946539.292301:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef932720e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd07 expref: 23 pid: 11315 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946539.292358:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 40 00000100:00100000:0.0:1790946539.292367:0:5820:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91469829ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+23:2363:x1877943286532480:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790946539.292386:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790946539.292393:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef932720e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd07 expref: 23 pid: 11315 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946539.292406:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef932720e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd07 expref: 23 pid: 11315 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946539.292431:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef932720e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd07 expref: 23 pid: 11315 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946539.292472:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91469e29d900) 00010000:00010000:0.0:1790946539.292477:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef932720fe lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946539.292488:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef932720fe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946539.292497:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef932720fe lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946539.292526:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790946539.292598:0:5820:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91469829ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+22:2363:x1877943286532480:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 232us (2098us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946539.292606:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 40 00010000:00010000:1.0:1790946539.293458:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef932720fe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946539.293474:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef932720fe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790946539.293503:0:5834:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1790946539.293708:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef932720f7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd15 expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946539.293732:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef932720fe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd15 expref: 22 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946539.293741:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91469e29d900) 00010000:00010000:1.0:1790946539.293765:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790946539.293769:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b180ee00, rc 0) 00000100:00100000:1.0:1790946539.293826:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91469829e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+22:10404:x1877943286532352:12345-192.168.203.13@tcp:101:bash.0 Request processed in 10357us (16906us total) trans 4294967342 rc 0/0 00000100:00100000:1.0:1790946539.293835:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 57 00000100:00100000:0.0:1790946539.299823:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946539.299989:0:11315:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286532736 00000100:00100000:2.0:1790946539.300004:0:11315:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286532736 00000100:00100000:2.0:1790946539.300087:0:11315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 58 00000100:00100000:2.0:1790946539.300099:0:11315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468e93d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+22:10404:x1877943286532736:12345-192.168.203.13@tcp:36:bash.0 00010000:00010000:2.0:1790946539.300707:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef9327210c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.300731:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef9327210c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.300761:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef9327210c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790946539.300827:0:11315:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967343 00000004:00010000:2.0:1790946539.300854:0:11315:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000006b16af5e reply state 000000003343008c transno 4294967344 ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef9327210c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946539.300864:0:11315:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790946539.300986:0:11315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468e93d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+25:10404:x1877943286532736:12345-192.168.203.13@tcp:36:bash.0 Request processed in 887us (1175us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1790946539.300994:0:11315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 58 00000020:00080000:2.0:1790946539.301000:0:11315:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790946539.303976:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef9327210c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946539.304000:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef9327210c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946539.304010:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef9327210c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946539.304017:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aef800 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:0.0:1790946539.304024:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef9327210c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946539.304033:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef9327210c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946539.304073:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91469e29d900) 00010000:00010000:0.0:1790946539.304077:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790946539.304084:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef9327210c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946539.304091:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef9327210c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946539.308129:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946539.308821:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286532864 00000100:00100000:2.0:1790946539.308846:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286532864 00000100:00100000:2.0:1790946539.308924:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 59 00000100:00100000:2.0:1790946539.308935:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468e93ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+24:10404:x1877943286532864:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:2.0:1790946539.308968:0:6803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946539.308995:0:6803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef93272113 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cd1c expref: -99 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.309131:0:6803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefa00/0x16e41aef9327211a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.309148:0:6803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef932720fe lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd15 expref: 25 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.309166:0:6803:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefa00/0x16e41aef9327211a lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.309260:0:6803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef932720fe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd15 expref: 25 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.309562:0:6803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef932720fe lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd15 expref: 25 pid: 5834 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946539.309581:0:6803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5eb0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6803:1877943303340928:192.168.203.13@tcp:104: 00000100:00100000:2.0:1790946539.309705:0:6803:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146b79a5780 going to sleep for 11 seconds 00000100:00100000:2.0:1790946539.313089:0:6803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5eb0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6803:1877943303340928:192.168.203.13@tcp:104: 00010000:00010000:2.0:1790946539.313128:0:6803:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefa00/0x16e41aef9327211a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946539.314897:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946539.315095:0:5821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286532992 00000100:00100000:1.0:1790946539.315108:0:5821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286532992 00010000:00010000:1.0:1790946539.315164:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef932720fe lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd15 expref: 26 pid: 5834 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946539.315251:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 41 00000100:00100000:1.0:1790946539.315289:0:5821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468e93e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+26:2364:x1877943286532992:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790946539.315310:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790946539.315317:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef932720fe lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd15 expref: 26 pid: 5834 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946539.315332:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef932720fe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd15 expref: 26 pid: 5834 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946539.315359:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef932720fe lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd15 expref: 26 pid: 5834 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946539.315380:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91469e29d900) 00010000:00010000:1.0:1790946539.315386:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefa00/0x16e41aef9327211a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946539.315399:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefa00/0x16e41aef9327211a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946539.315408:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefa00/0x16e41aef9327211a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946539.315457:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790946539.315524:0:5821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468e93e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+25:2364:x1877943286532992:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 236us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946539.315531:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 41 00010000:00010000:2.0:1790946539.315702:0:6803:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefa00/0x16e41aef9327211a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.315711:0:6803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefa00/0x16e41aef9327211a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790946539.315786:0:6803:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1790946539.315792:0:6803:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790946539.315819:0:6803:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefa00/0x16e41aef9327211a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.315858:0:6803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef93272113 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd1c expref: 25 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.315888:0:6803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefa00/0x16e41aef9327211a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd1c expref: 24 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.315896:0:6803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91469e29d900) 00010000:00010000:2.0:1790946539.315899:0:6803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790946539.315901:0:6803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914688aefa00, rc 0) 00000100:00100000:2.0:1790946539.315933:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468e93ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+24:10404:x1877943286532864:12345-192.168.203.13@tcp:101:bash.0 Request processed in 7000us (7819us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946539.315942:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 59 00000100:00100000:3.0:1790946539.329046:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946539.329253:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286533248 00000100:00100000:1.0:1790946539.329277:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286533248 00000100:00100000:1.0:1790946539.329350:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00100000:1.0:1790946539.329362:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b2652c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+24:10404:x1877943286533248:12345-192.168.203.13@tcp:35:bash.0 00000100:00100000:1.0:1790946539.329894:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b2652c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+25:10404:x1877943286533248:12345-192.168.203.13@tcp:35:bash.0 Request processed in 532us (861us total) trans 4294967345 rc 0/0 00000100:00100000:1.0:1790946539.329904:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00100000:2.0:1790946539.414767:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946539.415104:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286533504 00000100:00100000:1.0:1790946539.415118:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286533504 00000100:00100000:3.0:1790946539.415635:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 60 00000100:00100000:3.0:1790946539.415653:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5eb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+25:10414:x1877943286533504:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1790946539.415690:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946539.415985:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93272121 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cd23 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790946539.416109:0:5834:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1790946539.416292:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93272121 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd23 expref: 27 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946539.416397:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9146a0a5e400) 00010000:00010000:3.0:1790946539.416400:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790946539.416407:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93272121 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd23 expref: 27 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946539.416497:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146a032b400, rc 0) 00000100:00100000:3.0:1790946539.417127:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5eb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+26:10414:x1877943286533504:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 1475us (2382us total) trans 4294967346 rc 301/301 00000100:00100000:3.0:1790946539.417139:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 60 00000100:00100000:0.0:1790946539.419747:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946539.419966:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286533632 00000100:00100000:1.0:1790946539.419981:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286533632 00000100:00100000:1.0:1790946539.420090:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 61 00000100:00100000:1.0:1790946539.420102:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468e93fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+26:10414:x1877943286533632:12345-192.168.203.13@tcp:34:lfs.0 00010000:00010000:1.0:1790946539.420244:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef9327212f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946539.420435:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef9327212f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946539.420451:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef9327212f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946539.420470:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272136 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946539.420479:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272136 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946539.420486:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272136 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946539.420865:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327213d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946539.420876:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327213d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946539.420893:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327213d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790946539.420953:0:5836:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327213d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946539.420968:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef9327212f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946539.420977:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef9327212f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946539.420984:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef9327212f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946539.420991:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180ee00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:1.0:1790946539.420996:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef9327212f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946539.421005:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef9327212f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946539.421020:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91469e29d100) 00010000:00010000:1.0:1790946539.421023:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790946539.421028:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef9327212f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946539.421035:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef9327212f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946539.421049:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272136 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946539.421062:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272136 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946539.421068:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272136 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946539.421074:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180e600 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:1.0:1790946539.421077:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272136 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946539.421083:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272136 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946539.421091:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91469e29d400) 00010000:00010000:1.0:1790946539.421094:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790946539.421097:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272136 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946539.421103:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272136 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946539.421120:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327213d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946539.421126:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327213d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946539.421132:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327213d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946539.421137:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180fa00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:1.0:1790946539.421149:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327213d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946539.421156:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327213d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946539.421164:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91469e29d900) 00010000:00010000:1.0:1790946539.421166:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790946539.421169:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327213d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946539.421175:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327213d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946539.421795:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468e93fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+26:10414:x1877943286533632:12345-192.168.203.13@tcp:34:lfs.0 Request processed in 1687us (2064us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946539.421807:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 61 00000100:00100000:0.0:1790946539.424166:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946539.424536:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286533888 00000100:00100000:1.0:1790946539.424549:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286533888 00000100:00100000:1.0:1790946539.424668:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:1.0:1790946539.424680:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468e93d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+26:10414:x1877943286533888:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:1.0:1790946539.425044:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468e93d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+27:10414:x1877943286533888:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 365us (890us total) trans 4294967347 rc 0/0 00000100:00100000:1.0:1790946539.425053:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:0.0:1790946539.462330:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946539.462426:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286534144 00000100:00100000:2.0:1790946539.462441:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286534144 00000100:00100000:2.0:1790946539.462525:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 62 00000100:00100000:2.0:1790946539.462537:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468e93ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+27:10417:x1877943286534144:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1790946539.462567:0:6803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946539.462592:0:6803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef93272144 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cd2a expref: -99 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.462698:0:6803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef9327214b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.462715:0:6803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef9327214b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.462752:0:6803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef9327214b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.462781:0:6803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef93272152 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.462790:0:6803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef93272152 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.462798:0:6803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef93272152 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.463170:0:6803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef93272159 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.463180:0:6803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef93272159 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.463187:0:6803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef93272159 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790946539.463197:0:6803:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1790946539.463347:0:6803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef9327214b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.463355:0:6803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef9327214b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.463362:0:6803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef9327214b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.463369:0:6803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aef000 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:2.0:1790946539.463380:0:6803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef9327214b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.463389:0:6803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef9327214b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.463404:0:6803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91469e29d100) 00010000:00010000:2.0:1790946539.463407:0:6803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790946539.463413:0:6803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef9327214b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.463421:0:6803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef9327214b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.463435:0:6803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef93272152 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.463442:0:6803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef93272152 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.463447:0:6803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef93272152 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.463453:0:6803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aef800 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:2.0:1790946539.463456:0:6803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef93272152 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.463462:0:6803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef93272152 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.463470:0:6803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9146a0a5e500) 00010000:00010000:2.0:1790946539.463472:0:6803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790946539.463481:0:6803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef93272152 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.463488:0:6803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef93272152 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.463540:0:6803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef93272144 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd2a expref: 30 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.463554:0:6803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef93272159 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd2a expref: 29 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.463561:0:6803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91469e29d900) 00010000:00010000:2.0:1790946539.463564:0:6803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790946539.463567:0:6803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914688aee000, rc 0) 00000100:00100000:2.0:1790946539.463690:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468e93ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+29:10417:x1877943286534144:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 1156us (1373us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1790946539.463699:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 62 00000100:00100000:0.0:1790946539.477111:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946539.477192:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286534272 00000100:00100000:3.0:1790946539.477242:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286534272 00000100:00100000:0.0:1790946539.477259:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946539.477316:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 63 00000100:00100000:3.0:1790946539.477325:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468e93dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+29:10417:x1877943286534272:12345-192.168.203.13@tcp:54:lfs.0 00000100:00100000:2.0:1790946539.477379:0:5819:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286534400 00000100:00100000:2.0:1790946539.477385:0:5819:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286534400 00000100:00100000:2.0:1790946539.477426:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:2.0:1790946539.477432:0:5819:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468e93c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+30:2361:x1877943286534400:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790946539.477444:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790946539.477468:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef93272159 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd2a expref: 30 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.477488:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91469e29d900) 00010000:00010000:2.0:1790946539.477492:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790946539.477616:0:5819:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468e93c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+29:2361:x1877943286534400:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 182us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946539.477622:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 4 00010000:00010000:3.0:1790946539.477672:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93272167 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946539.477689:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93272167 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946539.477699:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93272167 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946539.477739:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93272167 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946539.477746:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93272167 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946539.477751:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93272167 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946539.477767:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146a032b400 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946539.477772:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93272167 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946539.477778:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93272167 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946539.477784:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91469e29d900) 00010000:00010000:3.0:1790946539.477786:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790946539.477789:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93272167 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946539.477793:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93272167 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946539.477912:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468e93dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+28:10417:x1877943286534272:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 586us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946539.477920:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 63 00000100:00100000:0.0:1790946539.479338:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946539.479525:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286534656 00000100:00100000:2.0:1790946539.479536:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286534656 00000100:00100000:2.0:1790946539.479795:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:2.0:1790946539.479807:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468e93f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+28:10417:x1877943286534656:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:2.0:1790946539.480142:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468e93f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+29:10417:x1877943286534656:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 338us (951us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1790946539.480149:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:0.0:1790946539.608068:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946539.608171:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286534912 00000100:00100000:2.0:1790946539.608184:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286534912 00000100:00100000:2.0:1790946539.608313:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 64 00000100:00100000:2.0:1790946539.608324:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468e93c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+29:10435:x1877943286534912:12345-192.168.203.13@tcp:101:cat.0 00010000:00010000:2.0:1790946539.608355:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946539.608382:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef9327216e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cd31 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.608524:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef93272175 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.608544:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef93272175 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.608558:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef93272175 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790946539.608571:0:5836:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1790946539.608744:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef9327216e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd31 expref: 32 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.608794:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef93272175 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd31 expref: 31 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.608804:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91469e29d900) 00010000:00010000:2.0:1790946539.608808:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1790946539.608812:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914688aee400, rc 0) 00000100:00100000:2.0:1790946539.608887:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468e93c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+31:10435:x1877943286534912:12345-192.168.203.13@tcp:101:cat.0 Request processed in 564us (832us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1790946539.608895:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 64 00000100:00100000:0.0:1790946539.632631:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946539.632750:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286535040 00000100:00100000:2.0:1790946539.632777:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286535040 00000100:00100000:2.0:1790946539.632920:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 65 00000100:00100000:2.0:1790946539.632933:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468e93c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+31:10436:x1877943286535040:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1790946539.632965:0:6803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946539.632991:0:6803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef93272183 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cd38 expref: -99 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.633090:0:6803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef9327218a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.633107:0:6803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef9327218a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.633120:0:6803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef9327218a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790946539.633163:0:6803:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1790946539.633184:0:6803:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790946539.633287:0:6803:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef9327218a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.633319:0:6803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef93272183 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd38 expref: 33 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.633340:0:6803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef9327218a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd38 expref: 32 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.633351:0:6803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91469e29d100) 00010000:00010000:2.0:1790946539.633354:0:6803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790946539.633358:0:6803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914688aef800, rc 0) 00000100:00100000:2.0:1790946539.633424:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468e93c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+32:10436:x1877943286535040:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 494us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946539.633432:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 65 00000100:00100000:0.0:1790946539.639913:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946539.640157:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286535424 00000100:00100000:1.0:1790946539.640171:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286535424 00000100:00100000:1.0:1790946539.640276:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:1.0:1790946539.640288:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468e93f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+32:10436:x1877943286535424:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:1.0:1790946539.641025:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468e93f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+33:10436:x1877943286535424:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 736us (1124us total) trans 4294967351 rc 0/0 00000100:00100000:1.0:1790946539.641035:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:0.0:1790946539.647506:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946539.648150:0:5820:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286535552 00000100:00100000:1.0:1790946539.648181:0:5820:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286535552 00000100:00100000:1.0:1790946539.648302:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:1.0:1790946539.648314:0:5820:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468e93d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+33:10436:x1877943286535552:12345-192.168.203.13@tcp:103:lfs.0 00010000:00010000:1.0:1790946539.648334:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1790946539.648366:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefa00/0x16e41aef9327211a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd1c expref: 33 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946539.648393:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef93272175 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd31 expref: 32 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946539.648406:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef9327201e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ccdd expref: 31 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946539.648429:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91469e29d900) 00010000:00010000:1.0:1790946539.648442:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790946539.648514:0:5820:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468e93d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+30:10436:x1877943286535552:12345-192.168.203.13@tcp:103:lfs.0 Request processed in 202us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946539.648522:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:3.0:1790946539.651398:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946539.651512:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286535680 00000100:00100000:1.0:1790946539.651525:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286535680 00000100:00100000:1.0:1790946539.651586:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 66 00000100:00100000:1.0:1790946539.651595:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91469829d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+30:10436:x1877943286535680:12345-192.168.203.13@tcp:58:lfs.0 00010000:00010000:1.0:1790946539.651748:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef93272191 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946539.651780:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef93272191 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946539.651806:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef93272191 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790946539.652548:0:5834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790946539.652712:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1790946539.652810:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1790946539.652955:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91469829d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+30:10436:x1877943286535680:12345-192.168.203.13@tcp:58:lfs.0 Request processed in 1356us (1569us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946539.652967:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 66 00000100:00100000:0.0:1790946539.669099:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946539.669258:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286535808 00000100:00100000:2.0:1790946539.669272:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286535808 00000100:00100000:2.0:1790946539.669349:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 67 00000100:00100000:2.0:1790946539.669362:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468e93df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+30:10438:x1877943286535808:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1790946539.669388:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946539.669415:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef93272198 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cd3f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.669500:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef9327219f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.669517:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef9327219f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.669552:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef9327219f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.669569:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef932721a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.669577:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef932721a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.669584:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef932721a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.669876:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef932721ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.669907:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef932721ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.669914:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef932721ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790946539.669958:0:5836:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1790946539.669963:0:5836:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790946539.669984:0:5836:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef932721ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.669997:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef932721ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.670006:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef9327219f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.670032:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef9327219f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.670040:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef9327219f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.670047:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aef000 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:2.0:1790946539.670052:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef9327219f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.670060:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef9327219f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.670074:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91469e29d100) 00010000:00010000:2.0:1790946539.670077:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790946539.670083:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef9327219f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.670090:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef9327219f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.670104:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef932721a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.670110:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef932721a6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.670116:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef932721a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.670121:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aee600 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:2.0:1790946539.670130:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef932721a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.670136:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef932721a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.670144:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9146a0a5e500) 00010000:00010000:2.0:1790946539.670146:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790946539.670149:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef932721a6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.670155:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef932721a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.670191:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef93272198 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd3f expref: 32 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.670248:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef932721ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd3f expref: 31 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946539.670257:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91469e29d400) 00010000:00010000:2.0:1790946539.670259:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790946539.670262:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914688aeec00, rc 0) 00000100:00100000:2.0:1790946539.670345:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468e93df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+31:10438:x1877943286535808:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 986us (1260us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946539.670354:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 67 00010000:00010000:3.0:1790946539.824376:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790946540.530911:0:12005:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790946540.530926:0:12005:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790946540.530975:0:12005:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1790946540.530984:0:12005:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1790946540.597048:0:11687:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790946540.597062:0:11687:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790946540.597133:0:11687:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1790946540.597145:0:11687:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790946540.597322:0:11687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914688710a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11687:1877943303341056:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790946540.597460:0:11687:0:(client.c:2716:ptlrpc_set_wait()) set ffff914698bef3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790946540.603911:0:11687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914688710a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11687:1877943303341056:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790946540.603912:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946540.603955:0:5845:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286535936 00000100:00100000:0.0:1790946540.603963:0:5845:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286535936 00000100:00100000:0.0:1790946540.604045:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 1 00000100:00100000:0.0:1790946540.604055:0:5845:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468e93ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+32:10450:x1877943286535936:12345-192.168.203.13@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1790946540.604157:0:5845:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468e93ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+32:10450:x1877943286535936:12345-192.168.203.13@tcp:900:lhsmtool_posix.0 Request processed in 103us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946540.604167:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 1 00000100:00100000:2.0:1790946540.614757:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946540.614844:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286536064 00000100:00100000:3.0:1790946540.614867:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286536064 00000100:00100000:3.0:1790946540.614945:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 68 00000100:00100000:3.0:1790946540.614957:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5eb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+31:10450:x1877943286536064:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790946540.615001:0:6803:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790946540.615146:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5eb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+31:10450:x1877943286536064:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 191us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946540.615155:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 68 00000100:00100000:0.0:1790946540.628507:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946540.628773:0:11315:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286536192 00000100:00100000:3.0:1790946540.628786:0:11315:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286536192 00000100:00100000:3.0:1790946540.628858:0:11315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 69 00000100:00100000:3.0:1790946540.628869:0:11315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468e93f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+31:10450:x1877943286536192:12345-192.168.203.13@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1790946540.628967:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef932721b4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.628991:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef932721b4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.629008:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef932721b4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.629025:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef932721bb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.629032:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef932721bb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.629039:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef932721bb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.629072:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef932721c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.629095:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef932721c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.629102:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef932721c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790946540.629152:0:11315:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1790946540.629157:0:11315:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790946540.629174:0:11315:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef932721c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.629188:0:11315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef932721b4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.629196:0:11315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef932721b4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.629260:0:11315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef932721b4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.629267:0:11315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146a032b400 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946540.629272:0:11315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef932721b4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.629281:0:11315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef932721b4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.629296:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9146a0a5e900) 00010000:00010000:3.0:1790946540.629300:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946540.629306:0:11315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef932721b4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.629324:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef932721b4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.629340:0:11315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef932721bb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.629347:0:11315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef932721bb lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.629353:0:11315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef932721bb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.629358:0:11315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146a032ae00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946540.629361:0:11315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef932721bb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.629368:0:11315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef932721bb lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.629375:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9146836dfe00) 00010000:00010000:3.0:1790946540.629379:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946540.629382:0:11315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef932721bb lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.629388:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef932721bb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.629404:0:11315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef932721c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.629422:0:11315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef932721c2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.629434:0:11315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef932721c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.629439:0:11315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146a032bc00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946540.629442:0:11315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef932721c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.629449:0:11315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef932721c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.629458:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91469e29d400) 00010000:00010000:3.0:1790946540.629460:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946540.629463:0:11315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef932721c2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.629469:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef932721c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946540.629566:0:11315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468e93f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+31:10450:x1877943286536192:12345-192.168.203.13@tcp:34:lhsmtool_posix.0 Request processed in 698us (1072us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946540.629576:0:11315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 69 00000100:00100000:3.0:1790946540.631791:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946540.631989:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286536448 00000100:00100000:0.0:1790946540.632003:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286536448 00000100:00100000:0.0:1790946540.632097:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 70 00000100:00100000:0.0:1790946540.632109:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91469829ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+31:10450:x1877943286536448:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790946540.632136:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946540.632162:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cb200/0x16e41aef932721c9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cd46 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946540.632766:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cac00/0x16e41aef932721d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946540.632787:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cac00/0x16e41aef932721d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946540.632801:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cac00/0x16e41aef932721d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790946540.632815:0:5836:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1790946540.632941:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cac00/0x16e41aef932721d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946540.632951:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cac00/0x16e41aef932721d0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946540.632968:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cac00/0x16e41aef932721d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946540.632974:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146c20cac00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:0.0:1790946540.632978:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cac00/0x16e41aef932721d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946540.632987:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cac00/0x16e41aef932721d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946540.633002:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91469e29d400) 00010000:00010000:0.0:1790946540.633006:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790946540.633011:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cac00/0x16e41aef932721d0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946540.633018:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cac00/0x16e41aef932721d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946540.633074:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cb200/0x16e41aef932721c9 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd46 expref: 33 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946540.633085:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9146a0a5e900) 00010000:00010000:0.0:1790946540.633088:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790946540.633092:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cb200/0x16e41aef932721c9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd46 expref: 33 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946540.633102:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146c20cb200, rc 0) 00000100:00100000:0.0:1790946540.633192:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91469829ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+32:10450:x1877943286536448:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 1086us (1418us total) trans 4294967352 rc 301/301 00000100:00100000:0.0:1790946540.633641:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 70 00000100:00100000:3.0:1790946540.637261:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946540.637348:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286536576 00000100:00100000:2.0:1790946540.637370:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286536576 00000100:00100000:2.0:1790946540.637496:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 71 00000100:00100000:2.0:1790946540.637509:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91469829e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+32:10450:x1877943286536576:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790946540.637559:0:5834:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790946540.637708:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91469829e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+32:10450:x1877943286536576:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 201us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946540.637717:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 71 00000100:00100000:2.0:1790946540.641547:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946540.641688:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286536832 00000100:00100000:1.0:1790946540.641701:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286536832 00000100:00100000:1.0:1790946540.641798:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 72 00000100:00100000:1.0:1790946540.641810:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5eb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+32:10450:x1877943286536832:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790946540.641838:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946540.641842:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1790946540.641875:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef9327218a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd38 expref: 32 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946540.641897:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91469e29d100) 00010000:00010000:1.0:1790946540.641903:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790946540.641919:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef932721de lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cd4d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790946540.643790:0:5835:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1790946540.644152:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef932721e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946540.644173:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef932721e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946540.644187:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef932721e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946540.644491:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef932721de lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd4d expref: 34 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946540.644511:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef932721e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd4d expref: 33 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946540.644521:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91469e29d900) 00010000:00010000:1.0:1790946540.644524:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790946540.644527:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b180f600, rc 0) 00000100:00100000:1.0:1790946540.644662:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5eb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+33:10450:x1877943286536832:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 2854us (3129us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1790946540.644672:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 72 00000100:00100000:3.0:1790946540.652321:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946540.652372:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286537088 00000100:00100000:3.0:1790946540.652385:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286537088 00000100:00100000:3.0:1790946540.652462:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 73 00000100:00100000:3.0:1790946540.652473:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91469829fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+33:10450:x1877943286537088:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790946540.652557:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790946540.652591:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef932721e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd4d expref: 33 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.652610:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91469e29d900) 00010000:00010000:3.0:1790946540.652623:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790946540.652651:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef932721f3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.652668:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef932721f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.652678:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef932721f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.652694:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef932721fa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x8b47555b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.652700:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef932721fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x8b47555b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.652707:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef932721fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x8b47555b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.653123:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef932721f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.653134:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef932721f3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.653141:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef932721f3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.653152:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146a032bc00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946540.653158:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef932721f3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.653166:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef932721f3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.653176:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91469e29d100) 00010000:00010000:3.0:1790946540.653179:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946540.653184:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef932721f3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.653190:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef932721f3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.653230:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef932721fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x8b47555b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.653236:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef932721fa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x8b47555b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.653242:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef932721fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x8b47555b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.653247:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146a032ae00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946540.653250:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef932721fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x8b47555b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.653256:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef932721fa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x8b47555b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.653276:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x8b47555b (ffff9146836dfe00) 00010000:00010000:3.0:1790946540.653279:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946540.653283:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef932721fa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x8b47555b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.653289:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef932721fa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x8b47555b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946540.653402:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91469829fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+32:10450:x1877943286537088:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 930us (1094us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790946540.653423:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 73 00000100:00100000:3.0:1790946540.655793:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946540.655892:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286537216 00000100:00100000:1.0:1790946540.655906:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286537216 00000100:00100000:1.0:1790946540.655976:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 74 00000100:00100000:1.0:1790946540.655990:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91469829d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+32:10450:x1877943286537216:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790946540.656160:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946540.656217:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef93272201 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cd54 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946540.656268:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272208 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946540.656285:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272208 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946540.656300:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272208 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946540.656598:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef93272201 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd54 expref: 34 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946540.656622:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272208 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd54 expref: 33 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946540.656633:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91469e29d600) 00010000:00010000:1.0:1790946540.656637:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790946540.656642:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b180f800, rc 0) 00000100:00100000:1.0:1790946540.656982:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91469829d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+33:10450:x1877943286537216:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 994us (1201us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946540.656992:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 74 00000100:00100000:0.0:1790946540.659819:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946540.659901:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286537472 00000100:00100000:1.0:1790946540.659915:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286537472 00000100:00100000:1.0:1790946540.659983:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 75 00000100:00100000:1.0:1790946540.659994:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be075f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+33:10450:x1877943286537472:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790946540.660097:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef9327220f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946540.660124:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef9327220f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946540.660138:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef9327220f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790946540.661086:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:1.0:1790946540.661102:0:5835:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 325732900617ns, next at 326732897262ns, rc = 0 00000004:00010000:1.0:1790946540.661384:0:5835:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000009c6629ff reply state 000000000b460037 transno 4294967354 ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef9327220f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946540.661399:0:5835:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790946540.661670:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be075f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+35:10450:x1877943286537472:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 1673us (1869us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1790946540.661679:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 75 00010000:00010000:2.0:1790946540.663497:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef9327220f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946540.663514:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef9327220f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946540.663523:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef9327220f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946540.663530:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180f600 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:2.0:1790946540.663536:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef9327220f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946540.663545:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef9327220f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946540.663564:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91469e29d600) 00010000:00010000:2.0:1790946540.663568:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790946540.663574:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef9327220f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946540.663581:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef9327220f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946540.664447:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946540.664545:0:11315:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286537600 00000100:00100000:3.0:1790946540.664558:0:11315:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286537600 00000100:00100000:3.0:1790946540.664628:0:11315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 76 00000100:00100000:3.0:1790946540.664638:0:11315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5eb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+34:10450:x1877943286537600:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790946540.664671:0:11315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946540.664695:0:11315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef93272216 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cd5b expref: -99 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.664983:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef93272216 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd5b expref: 35 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.665001:0:11315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef93272216 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd5b expref: 35 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.665024:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91469e29d600) 00010000:00010000:3.0:1790946540.665033:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790946540.665038:0:11315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146a032ae00, rc 0) 00000100:00100000:3.0:1790946540.665131:0:11315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5eb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+35:10450:x1877943286537600:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 493us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946540.665138:0:11315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 76 00000100:00100000:3.0:1790946540.669319:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946540.669361:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286537728 00000100:00100000:0.0:1790946540.669375:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286537728 00000100:00100000:0.0:1790946540.669435:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 25 00000100:00100000:0.0:1790946540.669445:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91469829ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2360:x1877943286537728:12345-192.168.203.13@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1790946540.669490:0:6673:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 7eed1f4b-bd5b-4a70-8045-59db065b3dfc@192.168.203.13@tcp t0 exp 0000000000000000 cur 325 last 0 00000020:00000080:0.0:1790946540.669536:0:6673:0:(genops.c:1384:class_connect()) connect: client 7eed1f4b-bd5b-4a70-8045-59db065b3dfc, cookie 0x16e41aef9327221d 00002000:00100000:0.0:1790946540.669554:0:6673:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7eed1f4b-bd5b-4a70-8045-59db065b3dfc/ffff9146beb37800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b03 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790946540.669568:0:6673:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type b7, return b7 00002000:00080000:0.0:1790946540.669895:0:6673:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1790946540.669936:0:6673:0:(import.c:65:import_set_state_nolock()) ffff9146beb31000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790946540.670036:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91469829ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2360:x1877943286537728:12345-192.168.203.13@tcp:8:lhsmtool_posix.0 Request processed in 590us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946540.670045:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 25 00000100:00100000:1.0:1790946540.674861:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946540.674999:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286537856 00000100:00100000:2.0:1790946540.675021:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286537856 00000100:00100000:2.0:1790946540.675116:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 26 00000100:00100000:2.0:1790946540.675128:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914688711180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:0:x1877943286537856:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1790946540.675228:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790946540.729586:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914688711180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+7:0:x1877943286537856:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 Request processed in 54447us (54721us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1790946540.729604:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 26 00000001:00100000:3.0:1790946540.729646:0:7645:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7eed1f4b-bd5b-4a70-8045-59db065b3dfc 00000001:00080000:3.0:1790946540.729663:0:7645:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:2.0:1790946540.736090:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946540.736261:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286538112 00000100:00100000:3.0:1790946540.736275:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286538112 00000100:00100000:3.0:1790946540.736729:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:3.0:1790946540.736741:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5eb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+35:10450:x1877943286538112:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1790946540.738612:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5eb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+36:10450:x1877943286538112:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 1859us (2521us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1790946540.738628:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:2.0:1790946540.742788:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946540.742886:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286538368 00000100:00100000:3.0:1790946540.742900:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286538368 00000100:00100000:3.0:1790946540.742968:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 77 00000100:00100000:3.0:1790946540.742979:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5eb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+36:10450:x1877943286538368:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790946540.743132:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5eb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+36:10450:x1877943286538368:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 154us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946540.743140:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 77 00000100:00100000:0.0:1790946540.750149:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946540.750533:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286538496 00000100:00100000:3.0:1790946540.750547:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286538496 00000100:00100000:3.0:1790946540.750616:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 78 00000100:00100000:3.0:1790946540.750628:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146875b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+36:10450:x1877943286538496:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790946540.750655:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946540.750680:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93272224 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cd62 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.750781:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef9327222b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.750799:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef9327222b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.750813:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef9327222b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790946540.750859:0:5835:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790946540.750883:0:5835:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef9327222b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.750915:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93272224 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd62 expref: 38 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.750933:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef9327222b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd62 expref: 37 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.750944:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91469e29d600) 00010000:00010000:3.0:1790946540.750947:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1790946540.750951:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146a032b400, rc 0) 00000100:00100000:3.0:1790946540.751042:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146875b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+37:10450:x1877943286538496:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 417us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946540.751051:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 78 00000100:00100000:0.0:1790946540.755929:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946540.756027:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286538624 00000100:00100000:3.0:1790946540.756042:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286538624 00000100:00100000:3.0:1790946540.756143:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 27 00000100:00100000:3.0:1790946540.756154:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+5:2364:x1877943286538624:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790946540.756179:0:6674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946540.756240:0:6674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9b292c9/0x16e41aef93272232 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cd69 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790946540.756274:0:6674:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abfacec, blocks: 0x1 00010000:00010000:3.0:1790946540.756298:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=325s v=(0 0) 00010000:00010000:3.0:1790946540.756303:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790946540.756315:0:6674:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9b292c9/0x16e41aef93272232 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd69 expref: 6 pid: 6674 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.756337:0:6674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f9b292c9/0x16e41aef93272232 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd69 expref: 6 pid: 6674 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.756352:0:6674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146a032be00, rc 0) 00000100:00100000:3.0:1790946540.756440:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2364:x1877943286538624:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 287us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946540.756447:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 27 00000100:00100000:3.0:1790946540.761924:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946540.762113:0:11315:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286538880 00000100:00100000:0.0:1790946540.762126:0:11315:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286538880 00000100:00100000:0.0:1790946540.762191:0:11315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 79 00000100:00100000:0.0:1790946540.762245:0:11315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91469829dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+37:10450:x1877943286538880:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790946540.762457:0:11315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91469829dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+37:10450:x1877943286538880:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 182us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946540.762465:0:11315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 79 00000100:00100000:1.0:1790946540.765178:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946540.765245:0:6808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286539008 00000100:00100000:3.0:1790946540.765269:0:6808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286539008 00000100:00100000:3.0:1790946540.765338:0:6808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 28 00000100:00100000:3.0:1790946540.765349:0:6808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914688710a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:10450:x1877943286539008:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790946540.765373:0:6808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946540.765396:0:6808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c0d581b/0x16e41aef93272239 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cd70 expref: -99 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.765646:0:6808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f9b292c9/0x16e41aef93272232 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd69 expref: 7 pid: 6674 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.765657:0:6808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790946540.765662:0:6808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790946540.765667:0:6808:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c0d581b/0x16e41aef93272239 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd70 expref: 7 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.765709:0:6808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f9b292c9/0x16e41aef93272232 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd69 expref: 7 pid: 6674 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.765725:0:6808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f9b292c9/0x16e41aef93272232 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd69 expref: 7 pid: 6674 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946540.766087:0:6808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91469829c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6808:1877943303341184:192.168.203.13@tcp:104: 00000100:00100000:3.0:1790946540.766300:0:6808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146879c76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790946540.771065:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946540.771245:0:5819:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286539136 00000100:00100000:2.0:1790946540.771257:0:5819:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286539136 00010000:00010000:2.0:1790946540.771313:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f9b292c9/0x16e41aef93272232 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd69 expref: 8 pid: 6674 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946540.771363:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 42 00000100:00100000:2.0:1790946540.771375:0:5819:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914685710850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+8:2364:x1877943286539136:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790946540.771395:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790946540.771434:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f9b292c9/0x16e41aef93272232 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd69 expref: 8 pid: 6674 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946540.771450:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f9b292c9/0x16e41aef93272232 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd69 expref: 8 pid: 6674 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946540.771480:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790946540.771485:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790946540.771495:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008c0d581b/0x16e41aef93272239 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd70 expref: 8 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946540.771547:0:5819:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c0d581b/0x16e41aef93272239 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd70 expref: 8 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946540.771624:0:5819:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008c0d581b/0x16e41aef93272239 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd70 expref: 8 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946540.771641:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be849180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5819:1877943303341312:192.168.203.13@tcp:105: 00000100:00100000:2.0:1790946540.771756:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set ffff914682b45e40 going to sleep for 11 seconds 00010000:00010000:3.0:1790946540.772284:0:6808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9b292c9/0x16e41aef93272232 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd69 expref: 8 pid: 6674 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946540.772320:0:6808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91469829c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6808:1877943303341184:192.168.203.13@tcp:104: 00010000:00010000:3.0:1790946540.772351:0:6808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008c0d581b/0x16e41aef93272239 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd70 expref: 7 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.772364:0:6808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146a032bc00, rc 0) 00000100:00100000:3.0:1790946540.772695:0:6808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914688710a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+7:10450:x1877943286539008:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 7345us (7525us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946540.772705:0:6808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 28 00000100:00100000:1.0:1790946540.775439:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be849180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5819:1877943303341312:192.168.203.13@tcp:105: 00010000:00010000:1.0:1790946540.775473:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790946540.775560:0:5819:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914685710850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2364:x1877943286539136:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 4185us (4509us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946540.775573:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 42 00000100:00100000:1.0:1790946540.778971:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946540.779328:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286539264 00000100:00100000:0.0:1790946540.779342:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286539264 00002000:00100000:0.0:1790946540.779417:0:6681:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff914688711f80 x1877943286539264/t0(0) o4->7eed1f4b-bd5b-4a70-8045-59db065b3dfc@192.168.203.13@tcp:481/0 lens 504/0 e 0 to 0 dl 1790946551 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790946540.779430:0:6681:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff914688711f80 with x1877943286539264 ext(0->8) 00002000:00010000:0.0:1790946540.779438:0:6681:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff914688711f80 00000100:00100000:0.0:1790946540.779474:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:0.0:1790946540.779485:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914688711f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2363:x1877943286539264:12345-192.168.203.13@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1790946540.780659:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914688711f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+8:2363:x1877943286539264:12345-192.168.203.13@tcp:4:lhsmtool_posix.0 Request processed in 1170us (1698us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1790946540.780672:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 0 00002000:00100000:0.0:1790946540.780683:0:6681:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff914688711f80 x1877943286539264/t4294967302(0) o4->7eed1f4b-bd5b-4a70-8045-59db065b3dfc@192.168.203.13@tcp:481/0 lens 504/448 e 0 to 0 dl 1790946551 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790946540.780694:0:6681:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff914688711f80 with x1877943286539264 ext(0->8) 00002000:00010000:0.0:1790946540.780700:0:6681:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff914688711f80 00000100:00100000:0.0:1790946540.784074:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946540.784154:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286539392 00000100:00100000:3.0:1790946540.784167:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286539392 00000100:00100000:3.0:1790946540.784267:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 80 00000100:00100000:3.0:1790946540.784279:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be97bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+37:10450:x1877943286539392:12345-192.168.203.13@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1790946540.826955:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be97bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+37:10450:x1877943286539392:12345-192.168.203.13@tcp:44:lhsmtool_posix.0 Request processed in 42660us (42877us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946540.826973:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 80 00000001:00080000:1.0:1790946540.827531:0:5857:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000001:00080000:1.0:1790946540.827555:0:5857:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:1.0:1790946540.827560:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000100:00100000:2.0:1790946540.827833:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000020:00080000:1.0:1790946540.827983:0:5857:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:0.0:1790946540.828041:0:5868:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:0.0:1790946540.828055:0:5868:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000001:00080000:1.0:1790946540.828121:0:5857:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967355 is committed 00000100:00100000:2.0:1790946540.828182:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91469829c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303341440:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1790946540.828331:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946540.828662:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303341440 00000100:00100000:0.0:1790946540.828672:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303341440 00000100:00100000:0.0:1790946540.828787:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790946540.828797:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be848e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1877943303341440:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1790946540.829009:0:6673:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1790946540.829013:0:6673:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1790946540 00002000:00010000:0.0:1790946540.829024:0:6673:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1790946540.829027:0:6673:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1790946540 -> 1790946540 00002000:00010000:0.0:1790946540.829029:0:6673:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1790946540.829088:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be848e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1877943303341440:12345-0@lo:2:osp-syn-1-0.0 Request processed in 293us (757us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1790946540.829096:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:2.0:1790946540.829262:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91469829c000/2, rc 0, transno 4294967303 00000100:00100000:2.0:1790946540.829269:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91469829c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303341440:0@lo:2:osp-syn-1-0.0 00000100:00080000:3.0:1790946540.829351:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790946540.831608:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946540.831774:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286539520 00000100:00100000:1.0:1790946540.831786:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286539520 00000100:00100000:1.0:1790946540.831862:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 30 00000100:00100000:1.0:1790946540.831874:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be84a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+8:2363:x1877943286539520:12345-192.168.203.13@tcp:16:lhsmtool_posix.0 00010000:00010000:0.0:1790946540.850576:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1790946540.868855:0:7645:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:0.0:1790946540.868880:0:7645:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:3.0:1790946540.869080:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be84a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2363:x1877943286539520:12345-192.168.203.13@tcp:16:lhsmtool_posix.0 Request processed in 37196us (37475us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946540.869098:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 30 00000100:00100000:0.0:1790946540.875328:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946540.875721:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286539776 00000100:00100000:3.0:1790946540.875736:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286539776 00000100:00100000:3.0:1790946540.875927:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 81 00000100:00100000:3.0:1790946540.875942:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be979180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+13:10450:x1877943286539776:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790946540.876047:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790946540.876083:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef9327222b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd62 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.876107:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91469e29d600) 00010000:00010000:3.0:1790946540.876113:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790946540.876151:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032be00/0x16e41aef93272240 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.876168:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032be00/0x16e41aef93272240 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.876179:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032be00/0x16e41aef93272240 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790946540.876587:0:5835:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000077ffa741 reply state 0000000004a1556d transno 4294967356 ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032be00/0x16e41aef93272240 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946540.876600:0:5835:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790946540.876740:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be979180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+14:10450:x1877943286539776:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 801us (1540us total) trans 4294967356 rc 0/0 00000100:00100000:3.0:1790946540.876758:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 81 00010000:00010000:3.0:1790946540.879576:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032be00/0x16e41aef93272240 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.879600:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032be00/0x16e41aef93272240 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.879609:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032be00/0x16e41aef93272240 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.879636:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146a032be00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946540.879643:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032be00/0x16e41aef93272240 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.879652:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032be00/0x16e41aef93272240 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.879673:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91469e29d600) 00010000:00010000:3.0:1790946540.879676:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946540.879683:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032be00/0x16e41aef93272240 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.879688:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032be00/0x16e41aef93272240 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946540.881260:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946540.881879:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286539904 00000100:00100000:3.0:1790946540.881894:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286539904 00000100:00100000:3.0:1790946540.881987:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 31 00000100:00100000:3.0:1790946540.881998:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be978380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2364:x1877943286539904:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1790946540.882562:0:6673:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1790946540.882568:0:6673:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1790946540 -> 1790946538 00002000:00010000:3.0:1790946540.882571:0:6673:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1790946537 00002000:00010000:3.0:1790946540.882573:0:6673:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1790946540 -> 1790946538 00002000:00010000:3.0:1790946540.882575:0:6673:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1790946540.883961:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be978380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+7:2364:x1877943286539904:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 Request processed in 1947us (2695us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1790946540.883977:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 31 00000100:00100000:0.0:1790946540.887237:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946540.887438:0:11315:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286540160 00000100:00100000:3.0:1790946540.887473:0:11315:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286540160 00000100:00100000:3.0:1790946540.887551:0:11315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 82 00000100:00100000:3.0:1790946540.887563:0:11315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b68aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+13:10450:x1877943286540160:12345-192.168.203.13@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1790946540.887654:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032be00/0x16e41aef93272247 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.887676:0:11315:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272208 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd54 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.887687:0:11315:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032be00/0x16e41aef93272247 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.887729:0:11315:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272208 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd54 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.887763:0:11315:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272208 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd54 expref: 13 pid: 5834 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946540.887780:0:11315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91469829f800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11315:1877943303341568:192.168.203.13@tcp:104: 00000100:00100000:3.0:1790946540.887916:0:11315:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146879c7840 going to sleep for 11 seconds 00000100:00100000:2.0:1790946540.891439:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946540.891599:0:5821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286540288 00000100:00100000:1.0:1790946540.891612:0:5821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286540288 00010000:00010000:1.0:1790946540.891665:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272208 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd54 expref: 14 pid: 5834 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946540.891717:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 43 00000100:00100000:1.0:1790946540.891728:0:5821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be84bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+14:2364:x1877943286540288:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790946540.891767:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790946540.891775:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272208 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd54 expref: 14 pid: 5834 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946540.891806:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272208 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd54 expref: 14 pid: 5834 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946540.891835:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91469e29d600) 00010000:00010000:1.0:1790946540.891851:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032be00/0x16e41aef93272247 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946540.891863:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032be00/0x16e41aef93272247 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946540.891872:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032be00/0x16e41aef93272247 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946540.891921:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790946540.892007:0:5821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be84bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+14:2364:x1877943286540288:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 279us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946540.892016:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 43 00010000:00010000:3.0:1790946540.894023:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272208 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd54 expref: 13 pid: 5834 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946540.894059:0:11315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91469829f800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11315:1877943303341568:192.168.203.13@tcp:104: 00010000:00010000:3.0:1790946540.894090:0:11315:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032be00/0x16e41aef93272247 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946540.894354:0:11315:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032be00/0x16e41aef93272247 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946540.894363:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032be00/0x16e41aef93272247 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946540.894723:0:11315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032be00/0x16e41aef93272247 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946540.894936:0:11315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032be00/0x16e41aef93272247 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946540.895040:0:11315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032be00/0x16e41aef93272247 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946540.895047:0:11315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146a032be00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:2.0:1790946540.895053:0:11315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032be00/0x16e41aef93272247 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946540.895063:0:11315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032be00/0x16e41aef93272247 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946540.895082:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91469e29d600) 00010000:00010000:2.0:1790946540.895085:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1790946540.895090:0:11315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032be00/0x16e41aef93272247 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946540.895097:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032be00/0x16e41aef93272247 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946540.895367:0:11315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b68aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+12:10450:x1877943286540160:12345-192.168.203.13@tcp:55:lhsmtool_posix.0 Request processed in 7802us (8179us total) trans 0 rc -22/-22 00000100:00100000:2.0:1790946540.895378:0:11315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 82 00000100:00100000:2.0:1790946540.899078:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946540.899195:0:6808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286540416 00000100:00100000:0.0:1790946540.899340:0:6808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286540416 00000100:00100000:0.0:1790946540.899495:0:6808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 32 00000100:00100000:0.0:1790946540.899507:0:6808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be849880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+7:2364:x1877943286540416:12345-192.168.203.13@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1790946540.899569:0:6808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000267d32e3/0x16e41aef9327224e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946540.899596:0:6808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008c0d581b/0x16e41aef93272239 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd70 expref: 7 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946540.899606:0:6808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946540.899611:0:6808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790946540.899616:0:6808:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000267d32e3/0x16e41aef9327224e lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946540.899691:0:6808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008c0d581b/0x16e41aef93272239 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd70 expref: 7 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946540.899714:0:6808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008c0d581b/0x16e41aef93272239 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd70 expref: 7 pid: 6808 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946540.899732:0:6808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be0c4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6808:1877943303341696:192.168.203.13@tcp:104: 00000100:00100000:0.0:1790946540.899903:0:6808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146c1c9fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790946540.905778:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946540.906522:0:6808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be0c4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6808:1877943303341696:192.168.203.13@tcp:104: 00010000:00010000:0.0:1790946540.906561:0:6808:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000267d32e3/0x16e41aef9327224e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946540.906641:0:5819:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286540544 00000100:00100000:2.0:1790946540.906651:0:5819:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286540544 00010000:00010000:2.0:1790946540.906698:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008c0d581b/0x16e41aef93272239 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd70 expref: 8 pid: 6808 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946540.907050:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 44 00000100:00100000:2.0:1790946540.907063:0:5819:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914688712680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+8:2364:x1877943286540544:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790946540.907099:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790946540.907128:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008c0d581b/0x16e41aef93272239 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd70 expref: 8 pid: 6808 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946540.907142:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008c0d581b/0x16e41aef93272239 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd70 expref: 8 pid: 6808 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946540.907169:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c0d581b/0x16e41aef93272239 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd70 expref: 8 pid: 6808 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946540.907191:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790946540.907196:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790946540.907234:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000267d32e3/0x16e41aef9327224e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946540.907246:0:5819:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000267d32e3/0x16e41aef9327224e lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946540.907272:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790946540.907342:0:5819:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914688712680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+7:2364:x1877943286540544:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 282us (1577us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946540.907349:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 44 00010000:00010000:0.0:1790946540.907786:0:6808:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000267d32e3/0x16e41aef9327224e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946540.907806:0:6808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000267d32e3/0x16e41aef9327224e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946540.907836:0:6808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000267d32e3/0x16e41aef9327224e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946540.907856:0:6808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000267d32e3/0x16e41aef9327224e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946540.907865:0:6808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000267d32e3/0x16e41aef9327224e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946540.907887:0:6808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146c20cb600 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:0.0:1790946540.907892:0:6808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000267d32e3/0x16e41aef9327224e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946540.907902:0:6808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000267d32e3/0x16e41aef9327224e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946540.907932:0:6808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000267d32e3/0x16e41aef9327224e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946540.907940:0:6808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000267d32e3/0x16e41aef9327224e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946540.908028:0:6808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be849880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2364:x1877943286540416:12345-192.168.203.13@tcp:1:lhsmtool_posix.0 Request processed in 8523us (8964us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946540.908037:0:6808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 32 00000100:00100000:0.0:1790946540.912065:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946540.912151:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286540800 00000100:00100000:3.0:1790946540.912180:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286540800 00000100:00100000:3.0:1790946540.912284:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 83 00000100:00100000:3.0:1790946540.912296:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be0c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+12:10450:x1877943286540800:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1790946540.912404:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef93272255 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.912436:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef93272255 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.912449:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef93272255 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.912779:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef9327225c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.913333:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef93272216 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd5b expref: 13 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.913347:0:5836:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef9327225c lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.913397:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef93272216 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd5b expref: 13 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.913471:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef93272216 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd5b expref: 13 pid: 11315 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946540.913491:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91469829f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5836:1877943303341824:192.168.203.13@tcp:104: 00000100:00100000:3.0:1790946540.913644:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146879c7840 going to sleep for 11 seconds 00000100:00100000:2.0:1790946540.919454:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946540.919585:0:5820:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286540928 00000100:00100000:0.0:1790946540.919597:0:5820:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286540928 00010000:00010000:0.0:1790946540.919652:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef93272216 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd5b expref: 14 pid: 11315 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946540.919703:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 45 00000100:00100000:0.0:1790946540.919713:0:5820:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be84aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+14:2363:x1877943286540928:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790946540.919732:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790946540.919773:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef93272216 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd5b expref: 14 pid: 11315 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946540.919798:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef93272216 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd5b expref: 14 pid: 11315 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946540.919827:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91469e29d600) 00010000:00010000:0.0:1790946540.919833:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef9327225c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946540.919855:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef9327225c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946540.919863:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef9327225c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946540.919887:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790946540.919968:0:5820:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be84aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+14:2363:x1877943286540928:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 245us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946540.919977:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 45 00010000:00010000:3.0:1790946540.920875:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef93272216 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd5b expref: 13 pid: 11315 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946540.920912:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91469829f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5836:1877943303341824:192.168.203.13@tcp:104: 00010000:00010000:3.0:1790946540.920939:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef9327225c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.920949:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef9327225c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946540.921054:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef9327225c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790946540.921333:0:5836:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:3.0:1790946540.921629:0:5836:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:3.0:1790946540.921684:0:5836:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1790946540.922615:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91469829f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5836:1877943303341952:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1790946540.922700:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946540.922852:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303341952 00000100:00100000:0.0:1790946540.922862:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303341952 00000100:00100000:0.0:1790946540.922934:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790946540.922946:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91469829c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5836:x1877943303341952:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1790946540.923228:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146879c7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790946540.923314:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91469829c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5836:x1877943303341952:12345-0@lo:1000:mdt00_002.0 Request processed in 369us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946540.923322:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790946540.923484:0:5836:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1790946540.923490:0:5836:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91469829c000, transno 4294967303 00000100:00100000:3.0:1790946540.923515:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91469829f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5836:1877943303341952:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1790946540.925503:0:5836:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:0.0:1790946540.925616:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be0c6300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5836:1877943303342080:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1790946540.925710:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946540.925910:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146c1c9fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1790946540.926063:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303342080 00000100:00100000:2.0:1790946540.926075:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303342080 00000100:00100000:2.0:1790946540.926178:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790946540.926189:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be0c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5836:x1877943303342080:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1790946540.926514:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be0c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5836:x1877943303342080:12345-0@lo:1000:mdt00_002.0 Request processed in 326us (804us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1790946540.926522:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790946540.926618:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be0c6300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5836:1877943303342080:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1790946540.926664:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef9327225c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946540.926676:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef9327225c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946540.926684:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef9327225c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946540.926692:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146a032b400 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:1.0:1790946540.926698:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef9327225c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946540.926706:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef9327225c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946540.926724:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91469e29d600) 00010000:00010000:1.0:1790946540.926727:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790946540.926732:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef9327225c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946540.926756:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef9327225c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946540.926827:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef93272191 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946540.926835:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef93272191 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946540.926842:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef93272191 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946540.926847:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180fa00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:1.0:1790946540.926850:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef93272191 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946540.926856:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef93272191 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946540.926865:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91469e29d400) 00010000:00010000:1.0:1790946540.926868:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790946540.926871:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef93272191 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946540.926877:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef93272191 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946540.926901:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef93272263 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946540.926918:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef932721ad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd3f expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946540.926928:0:5836:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef93272263 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946540.926981:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef932721ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd3f expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946540.926998:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef932721ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd3f expref: 16 pid: 5836 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946540.927011:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914688713800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5836:1877943303342208:192.168.203.13@tcp:104: 00000100:00100000:1.0:1790946540.927100:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff914698befa80 going to sleep for 11 seconds 00000100:00100000:1.0:1790946540.930558:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914688713800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5836:1877943303342208:192.168.203.13@tcp:104: 00010000:00010000:1.0:1790946540.930600:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef93272263 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946540.933609:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946540.933688:0:5819:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286541056 00000100:00100000:2.0:1790946540.933701:0:5819:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286541056 00010000:00010000:2.0:1790946540.933764:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef932721ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd3f expref: 17 pid: 5836 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946540.933835:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 46 00000100:00100000:0.0:1790946540.933849:0:5820:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be0c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+17:2363:x1877943286541056:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790946540.933868:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790946540.933877:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef932721ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd3f expref: 17 pid: 5836 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946540.933896:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef932721ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd3f expref: 17 pid: 5836 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946540.933926:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef932721ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd3f expref: 17 pid: 5836 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946540.934010:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91469e29d400) 00010000:00010000:0.0:1790946540.934017:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef93272263 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946540.934029:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef93272263 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946540.934038:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef93272263 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946540.934194:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef93272263 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946540.934194:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790946540.934232:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef93272263 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946540.934248:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef93272263 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946540.934257:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef93272263 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946540.934265:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef93272263 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946540.934271:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180ee00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:1.0:1790946540.934277:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef93272263 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946540.934301:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef93272263 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946540.934311:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91469e29d400) 00010000:00010000:1.0:1790946540.934314:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790946540.934319:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef93272263 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946540.934326:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef93272263 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946540.934340:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef93272255 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946540.934478:0:5820:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be0c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+16:2363:x1877943286541056:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 631us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946540.934486:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 46 00010000:00010000:1.0:1790946540.934622:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef93272255 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946540.934631:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef93272255 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946540.934637:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146a032a400 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:1.0:1790946540.934640:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef93272255 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946540.934645:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef93272255 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946540.934654:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91469e29d400) 00010000:00010000:1.0:1790946540.934657:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790946540.934660:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef93272255 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946540.934678:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef93272255 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946540.935711:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be0c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+15:10450:x1877943286540800:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 23408us (23650us total) trans 4294967361 rc 0/0 00000100:00100000:1.0:1790946540.935724:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 83 00000020:00080000:1.0:1790946540.935730:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1790946540.936711:0:11687:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790946540.936719:0:11687:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790946540.936771:0:11687:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1790946540.936784:0:11687:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790946540.938129:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946540.938347:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286541312 00000100:00100000:1.0:1790946540.938360:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286541312 00000100:00100000:1.0:1790946540.938559:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:1.0:1790946540.938572:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be0c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+15:10450:x1877943286541312:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1790946540.939485:0:5838:0:(mdd_object.c:4180:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1790946540.939608:0:5838:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967362 00010000:00010000:1.0:1790946540.939665:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327226a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946540.939685:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327226a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946540.939699:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327226a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946540.939709:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327226a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946540.939716:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327226a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946540.939723:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327226a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946540.939765:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1790946540.939895:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be0c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+17:10450:x1877943286541312:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 1323us (1774us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1790946540.939905:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 20 00000020:00080000:1.0:1790946540.939912:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790946540.940280:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790946540.940291:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327226a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946540.940300:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180fa00 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:0.0:1790946540.940304:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327226a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946540.940313:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327226a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946540.940327:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91469e29d600) 00010000:00010000:0.0:1790946540.940330:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1790946540.940335:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327226a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946540.940342:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327226a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946540.940363:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946540.940365:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946540.940366:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946541.040681:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be849c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303342336:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790946541.040795:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946541.041102:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303342336 00000100:00100000:1.0:1790946541.041113:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303342336 00000100:00100000:1.0:1790946541.041192:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1790946541.041231:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91469829f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1877943303342336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790946541.041284:0:6678:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00080000:3.0:1790946541.041301:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790946541.041354:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91469829f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1877943303342336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 152us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946541.041363:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790946541.041438:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be849c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303342336:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790946541.872787:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790946542.413711:0:12059:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790946542.413721:0:12059:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790946542.413771:0:12059:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1790946542.413781:0:12059:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790946542.545364:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946542.545414:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286541568 00000100:00100000:0.0:1790946542.545424:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286541568 00000100:00100000:0.0:1790946542.545481:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 84 00000100:00100000:0.0:1790946542.545491:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be0c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+17:10467:x1877943286541568:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1790946542.545522:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946542.545543:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cb200/0x16e41aef93272271 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cd77 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946542.545641:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cac00/0x16e41aef93272278 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946542.545654:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cac00/0x16e41aef93272278 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946542.545666:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cac00/0x16e41aef93272278 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790946542.545678:0:5835:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1790946542.545807:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cb200/0x16e41aef93272271 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd77 expref: 20 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946542.545824:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cac00/0x16e41aef93272278 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd77 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946542.545833:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91469e29d100) 00010000:00010000:0.0:1790946542.545835:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790946542.545839:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146c20cac00, rc 0) 00000100:00100000:0.0:1790946542.545892:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be0c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+19:10467:x1877943286541568:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 402us (537us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1790946542.545899:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 84 00000100:00080000:0.0:1790946542.545923:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790946542.562785:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946542.562898:0:11315:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286541696 00000100:00100000:2.0:1790946542.562907:0:11315:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286541696 00000100:00100000:2.0:1790946542.562958:0:11315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 85 00000100:00100000:2.0:1790946542.562968:0:11315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be848700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+19:10467:x1877943286541696:12345-192.168.203.13@tcp:34:lfs.0 00010000:00010000:2.0:1790946542.563040:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef93272286 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.563057:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef93272286 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.563068:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef93272286 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.563099:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef9327228d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.563106:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef9327228d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.563112:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef9327228d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.563337:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef93272294 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.563345:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef93272294 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.563352:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef93272294 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790946542.563390:0:11315:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef93272294 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.565888:0:11315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef93272286 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.565900:0:11315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef93272286 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.565909:0:11315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef93272286 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.565916:0:11315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aefc00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:2.0:1790946542.565920:0:11315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef93272286 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.565940:0:11315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef93272286 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.565957:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91469e29d100) 00010000:00010000:2.0:1790946542.565961:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790946542.565966:0:11315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef93272286 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.565972:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef93272286 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.565984:0:11315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef9327228d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.565991:0:11315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef9327228d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.565997:0:11315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef9327228d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.566002:0:11315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aef800 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:2.0:1790946542.566005:0:11315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef9327228d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.566011:0:11315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef9327228d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.566018:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9146a0a5eb00) 00010000:00010000:2.0:1790946542.566020:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790946542.566023:0:11315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef9327228d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.566039:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef9327228d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.566055:0:11315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef93272294 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.566061:0:11315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef93272294 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.566067:0:11315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef93272294 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.566072:0:11315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aef200 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:2.0:1790946542.566075:0:11315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef93272294 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.566080:0:11315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef93272294 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.566087:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9146a0a5e500) 00010000:00010000:2.0:1790946542.566089:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790946542.566091:0:11315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef93272294 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.566096:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef93272294 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946542.567389:0:11315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be848700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+19:10467:x1877943286541696:12345-192.168.203.13@tcp:34:lfs.0 Request processed in 4413us (4605us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946542.567490:0:11315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 85 00000100:00100000:0.0:1790946542.622301:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946542.622380:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286541952 00000100:00100000:1.0:1790946542.622391:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286541952 00000100:00100000:1.0:1790946542.622460:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 86 00000100:00100000:1.0:1790946542.622469:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be0c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+19:10470:x1877943286541952:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1790946542.622490:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946542.622510:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef9327229b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cd7e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946542.622583:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef932722a2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946542.622597:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef932722a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946542.622625:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef932722a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946542.622640:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef932722a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946542.622647:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef932722a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946542.622654:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef932722a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946542.622918:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef932722b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946542.622928:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef932722b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946542.622935:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef932722b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790946542.622944:0:5836:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1790946542.623032:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef932722a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946542.623039:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef932722a2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946542.623047:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef932722a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946542.623053:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180fc00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:1.0:1790946542.623063:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef932722a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946542.623070:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef932722a2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946542.623081:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91469e29d100) 00010000:00010000:1.0:1790946542.623084:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790946542.623089:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef932722a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946542.623096:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef932722a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946542.623108:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef932722a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946542.623114:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef932722a9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946542.623119:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef932722a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946542.623124:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180f800 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:1.0:1790946542.623126:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef932722a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946542.623132:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef932722a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946542.623139:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91469e29dd00) 00010000:00010000:1.0:1790946542.623141:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790946542.623149:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef932722a9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946542.623155:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef932722a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946542.623191:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef9327229b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd7e expref: 22 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946542.623245:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef932722b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd7e expref: 21 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946542.623253:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91469e29dc00) 00010000:00010000:1.0:1790946542.623256:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790946542.623258:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b180fa00, rc 0) 00000100:00100000:1.0:1790946542.623312:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be0c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+21:10470:x1877943286541952:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 844us (1021us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1790946542.623319:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 86 00000100:00100000:0.0:1790946542.627147:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946542.627283:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286542080 00000100:00100000:2.0:1790946542.627299:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286542080 00000100:00100000:2.0:1790946542.627374:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 87 00000100:00100000:2.0:1790946542.627388:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be0c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+21:10470:x1877943286542080:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:2.0:1790946542.627450:0:6803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef932722be lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.627469:0:6803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef932722be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.627480:0:6803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef932722be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.627505:0:6803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef932722be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.627512:0:6803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef932722be lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.627518:0:6803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef932722be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.627524:0:6803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aef800 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:2.0:1790946542.627528:0:6803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef932722be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.627535:0:6803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef932722be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.627546:0:6803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91469e29dc00) 00010000:00010000:2.0:1790946542.627549:0:6803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790946542.627553:0:6803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef932722be lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.627572:0:6803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef932722be lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946542.627656:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be0c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+21:10470:x1877943286542080:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 274us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946542.627663:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 87 00000100:00100000:2.0:1790946542.632562:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946542.632674:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286542336 00000100:00100000:3.0:1790946542.632687:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286542336 00000100:00100000:3.0:1790946542.632840:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:3.0:1790946542.632853:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b2651850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+21:10470:x1877943286542336:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:3.0:1790946542.633258:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b2651850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+22:10470:x1877943286542336:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 405us (708us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1790946542.633268:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:0.0:1790946542.681291:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946542.683495:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286542592 00000100:00100000:2.0:1790946542.683517:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286542592 00000100:00100000:2.0:1790946542.683625:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 88 00000100:00100000:2.0:1790946542.683640:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be0c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+22:9992:x1877943286542592:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:2.0:1790946542.683678:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946542.683704:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef932722c5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cd85 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.683840:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef932722cc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.683858:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef932722b0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd7e expref: 23 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.683869:0:5834:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef932722cc lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.683915:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef932722b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd7e expref: 23 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.683932:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef932722b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd7e expref: 23 pid: 5836 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946542.683977:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be84b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5834:1877943303342464:192.168.203.13@tcp:104: 00000100:00100000:2.0:1790946542.684120:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff914682b459c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790946542.689310:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be84b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5834:1877943303342464:192.168.203.13@tcp:104: 00010000:00010000:2.0:1790946542.689351:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef932722cc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946542.694158:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946542.694280:0:5821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286542720 00000100:00100000:2.0:1790946542.694298:0:5821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286542720 00010000:00010000:2.0:1790946542.694363:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef932722b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd7e expref: 24 pid: 5836 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946542.694421:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 47 00000100:00100000:2.0:1790946542.694433:0:5821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be0c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+24:2364:x1877943286542720:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790946542.694451:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790946542.694458:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef932722b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd7e expref: 24 pid: 5836 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.694472:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef932722b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd7e expref: 24 pid: 5836 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.694499:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef932722b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd7e expref: 24 pid: 5836 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.694521:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91469e29dc00) 00010000:00010000:2.0:1790946542.694527:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef932722cc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.694556:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef932722cc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.694565:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef932722cc lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.694607:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790946542.694701:0:5821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be0c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+23:2364:x1877943286542720:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 260us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946542.694710:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 47 00010000:00010000:0.0:1790946542.695176:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef932722cc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946542.695188:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef932722cc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790946542.695264:0:5834:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1790946542.695469:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef932722c5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd85 expref: 24 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946542.695491:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef932722cc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd85 expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946542.695498:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91469e29dc00) 00010000:00010000:0.0:1790946542.695501:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790946542.695504:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914688aefc00, rc 0) 00000100:00100000:0.0:1790946542.695805:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be0c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+23:9992:x1877943286542592:12345-192.168.203.13@tcp:101:bash.0 Request processed in 12169us (14521us total) trans 4294967367 rc 0/0 00000100:00100000:0.0:1790946542.695815:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 88 00000100:00100000:0.0:1790946542.698765:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946542.698862:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286542976 00000100:00100000:3.0:1790946542.698878:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286542976 00000100:00100000:3.0:1790946542.698945:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 89 00000100:00100000:3.0:1790946542.698956:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be0c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+23:9992:x1877943286542976:12345-192.168.203.13@tcp:36:bash.0 00010000:00010000:3.0:1790946542.699246:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef932722da lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946542.699264:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef932722da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946542.699276:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef932722da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790946542.699323:0:5835:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967368 00000004:00010000:3.0:1790946542.699347:0:5835:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ed311229 reply state 00000000f9ba6196 transno 4294967369 ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef932722da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946542.699356:0:5835:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1790946542.699413:0:5835:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967369 00000100:00100000:3.0:1790946542.699518:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be0c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+27:9992:x1877943286542976:12345-192.168.203.13@tcp:36:bash.0 Request processed in 563us (766us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1790946542.699525:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 89 00000020:00080000:3.0:1790946542.699530:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1790946542.702084:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef932722da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.702108:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef932722da lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.702118:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef932722da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.702126:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146a032ae00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:2.0:1790946542.702132:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef932722da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.702142:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef932722da lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.702164:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91469e29dc00) 00010000:00010000:2.0:1790946542.702167:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790946542.702173:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef932722da lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.702223:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef932722da lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946542.702780:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946542.702842:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286543104 00000100:00100000:2.0:1790946542.702856:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286543104 00000100:00100000:2.0:1790946542.702982:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 90 00000100:00100000:2.0:1790946542.702994:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be0c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+26:9992:x1877943286543104:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:2.0:1790946542.703026:0:6803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946542.703049:0:6803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef932722e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cd8c expref: -99 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.703144:0:6803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef932722e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd8c expref: 27 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.703160:0:6803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef932722e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd8c expref: 27 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.703182:0:6803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91469e29dc00) 00010000:00010000:2.0:1790946542.703185:0:6803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790946542.703188:0:6803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914688aeec00, rc 0) 00000100:00100000:2.0:1790946542.703294:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be0c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+27:9992:x1877943286543104:12345-192.168.203.13@tcp:101:bash.0 Request processed in 302us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946542.703302:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 90 00000100:00100000:3.0:1790946542.705420:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946542.705869:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286543232 00000100:00100000:1.0:1790946542.705886:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286543232 00000100:00100000:1.0:1790946542.705984:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 33 00000100:00100000:1.0:1790946542.705997:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91469829f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:9992:x1877943286543232:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:1.0:1790946542.706020:0:6674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946542.706051:0:6674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004357f1f7/0x16e41aef932722e8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cd93 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790946542.706083:0:6674:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6abfacea, atime: 0x6abface9, ctime: 0x6abfacea, blocks: 0xb 00010000:00010000:1.0:1790946542.706109:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=327s v=(0 0) 00010000:00010000:1.0:1790946542.706142:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946542.706152:0:6674:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004357f1f7/0x16e41aef932722e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd93 expref: 7 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946542.706175:0:6674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004357f1f7/0x16e41aef932722e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd93 expref: 7 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946542.706191:0:6674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b180e600, rc 0) 00000100:00100000:1.0:1790946542.706304:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91469829f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+7:9992:x1877943286543232:12345-192.168.203.13@tcp:101:bash.0 Request processed in 311us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946542.706310:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 33 00000100:00080000:0.0:1790946542.706677:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790946542.712047:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946542.712135:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286543360 00000100:00100000:2.0:1790946542.712152:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286543360 00002000:00010000:2.0:1790946542.712399:0:6679:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:2.0:1790946542.712406:0:6679:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91469829ed80 with x1877943286543360 ext(0->18446744073709551615) 00002000:00010000:2.0:1790946542.712441:0:6679:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91469829ed80. 00000100:00100000:2.0:1790946542.712488:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 1 00000100:00100000:2.0:1790946542.712500:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91469829ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+7:2364:x1877943286543360:12345-192.168.203.13@tcp:10:bash.0 00002000:00010000:2.0:1790946542.712902:0:6679:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1790946542.712906:0:6679:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1790946538 -> 1790946542 00002000:00010000:2.0:1790946542.712909:0:6679:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1790946537 -> 1790946537 00002000:00010000:2.0:1790946542.712912:0:6679:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1790946538 -> 1790946542 00002000:00010000:2.0:1790946542.712913:0:6679:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1790946542.713142:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91469829ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+8:2364:x1877943286543360:12345-192.168.203.13@tcp:10:bash.0 Request processed in 642us (1101us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1790946542.713152:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 1 00002000:00010000:2.0:1790946542.713156:0:6679:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:2.0:1790946542.713159:0:6679:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91469829ed80 with x1877943286543360 ext(0->18446744073709551615) 00002000:00010000:2.0:1790946542.713165:0:6679:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91469829ed80. 00000100:00100000:1.0:1790946542.792140:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946542.794566:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286543488 00000100:00100000:0.0:1790946542.794588:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286543488 00000100:00100000:0.0:1790946542.794773:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 91 00000100:00100000:0.0:1790946542.794787:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914688713800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+27:10484:x1877943286543488:12345-192.168.203.13@tcp:34:lfs.0 00010000:00010000:0.0:1790946542.794894:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cb600/0x16e41aef932722ef lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946542.794951:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cb600/0x16e41aef932722ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946542.794966:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cb600/0x16e41aef932722ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946542.794988:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cb200/0x16e41aef932722f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946542.794996:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cb200/0x16e41aef932722f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946542.795003:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cb200/0x16e41aef932722f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946542.795336:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef932722fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946542.795347:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef932722fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946542.795355:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef932722fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790946542.795410:0:5834:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef932722fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946542.795422:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cb600/0x16e41aef932722ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946542.795430:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cb600/0x16e41aef932722ef lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946542.795448:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cb600/0x16e41aef932722ef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946542.795455:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146c20cb600 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:0.0:1790946542.795460:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cb600/0x16e41aef932722ef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946542.795468:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cb600/0x16e41aef932722ef lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946542.795481:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91469e29d100) 00010000:00010000:0.0:1790946542.795484:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790946542.795490:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cb600/0x16e41aef932722ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946542.795495:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cb600/0x16e41aef932722ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946542.795510:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cb200/0x16e41aef932722f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946542.795516:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cb200/0x16e41aef932722f6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946542.795522:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cb200/0x16e41aef932722f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946542.795526:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146c20cb200 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:0.0:1790946542.795529:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cb200/0x16e41aef932722f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946542.795545:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cb200/0x16e41aef932722f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946542.795554:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff914686750d00) 00010000:00010000:0.0:1790946542.795556:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790946542.795559:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cb200/0x16e41aef932722f6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946542.795565:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cb200/0x16e41aef932722f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946542.795581:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef932722fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946542.795587:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef932722fd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946542.795594:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef932722fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946542.795599:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1933200 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:0.0:1790946542.795602:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef932722fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946542.795608:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef932722fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946542.795614:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91469e29dc00) 00010000:00010000:0.0:1790946542.795617:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790946542.795620:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef932722fd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946542.795636:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef932722fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946542.796049:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914688713800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+27:10484:x1877943286543488:12345-192.168.203.13@tcp:34:lfs.0 Request processed in 1261us (3919us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946542.796060:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 91 00000100:00100000:3.0:1790946542.824991:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946542.825064:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946542.825194:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286543744 00000100:00100000:0.0:1790946542.825259:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286543744 00000100:00100000:1.0:1790946542.825377:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286543616 00000100:00100000:1.0:1790946542.825388:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286543616 00002000:00100000:1.0:1790946542.825445:0:6681:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->7) req@ffff91469829c000 x1877943286543616/t0(0) o4->7eed1f4b-bd5b-4a70-8045-59db065b3dfc@192.168.203.13@tcp:483/0 lens 496/0 e 0 to 0 dl 1790946553 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790946542.825463:0:6681:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91469829c000 with x1877943286543616 ext(0->7) 00000100:00100000:0.0:1790946542.825463:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 34 00002000:00010000:1.0:1790946542.825476:0:6681:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91469829c000 00000100:00100000:0.0:1790946542.825487:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be05cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+9:2364:x1877943286543744:12345-192.168.203.13@tcp:16:kworker.0 00000100:00100000:1.0:1790946542.825515:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 2 00000100:00100000:1.0:1790946542.825527:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91469829c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+9:2364:x1877943286543616:12345-192.168.203.13@tcp:4:bash.0 00000100:00100000:1.0:1790946542.826019:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91469829c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+11:2364:x1877943286543616:12345-192.168.203.13@tcp:4:bash.0 Request processed in 493us (1034us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1790946542.826027:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 2 00002000:00100000:1.0:1790946542.826034:0:6681:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->7) req@ffff91469829c000 x1877943286543616/t4294967307(0) o4->7eed1f4b-bd5b-4a70-8045-59db065b3dfc@192.168.203.13@tcp:483/0 lens 496/448 e 0 to 0 dl 1790946553 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790946542.826052:0:6681:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91469829c000 with x1877943286543616 ext(0->7) 00002000:00010000:1.0:1790946542.826056:0:6681:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91469829c000 00000100:00100000:0.0:1790946542.854499:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946542.855337:0:11315:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286544000 00000100:00100000:3.0:1790946542.855353:0:11315:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286544000 00000100:00100000:3.0:1790946542.855619:0:11315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 92 00000100:00100000:3.0:1790946542.855632:0:11315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be0c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+27:10487:x1877943286544000:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1790946542.855658:0:11315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946542.855684:0:11315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032be00/0x16e41aef93272304 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cd9a expref: -99 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946542.855791:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef9327230b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946542.855812:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef9327230b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946542.855827:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef9327230b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946542.855846:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a200/0x16e41aef93272312 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946542.855853:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a200/0x16e41aef93272312 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946542.855861:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a200/0x16e41aef93272312 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946542.857001:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef93272319 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946542.857021:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef93272319 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946542.857040:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef93272319 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790946542.857056:0:11315:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1790946542.857177:0:11315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef9327230b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946542.857186:0:11315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef9327230b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946542.857194:0:11315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef9327230b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946542.857219:0:11315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146a032a800 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946542.857224:0:11315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef9327230b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946542.857233:0:11315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef9327230b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946542.857248:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91469e29d100) 00010000:00010000:3.0:1790946542.857251:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946542.857257:0:11315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef9327230b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946542.857262:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef9327230b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946542.857277:0:11315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a200/0x16e41aef93272312 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946542.857282:0:11315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a200/0x16e41aef93272312 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946542.857294:0:11315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a200/0x16e41aef93272312 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946542.857299:0:11315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146a032a200 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946542.857302:0:11315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a200/0x16e41aef93272312 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946542.857308:0:11315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a200/0x16e41aef93272312 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946542.857316:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9146836df300) 00010000:00010000:3.0:1790946542.857319:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946542.857322:0:11315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a200/0x16e41aef93272312 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946542.857328:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a200/0x16e41aef93272312 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946542.857386:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032be00/0x16e41aef93272304 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd9a expref: 30 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946542.857409:0:11315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef93272319 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd9a expref: 29 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946542.857417:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91469e29dc00) 00010000:00010000:3.0:1790946542.857419:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1790946542.857422:0:11315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146a032ae00, rc 0) 00000100:00100000:3.0:1790946542.857823:0:11315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be0c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+29:10487:x1877943286544000:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 1888us (3033us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1790946542.857845:0:11315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 92 00000100:00100000:0.0:1790946542.861803:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946542.861956:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286544128 00000100:00100000:2.0:1790946542.861969:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286544128 00000100:00100000:2.0:1790946542.862049:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 93 00000100:00100000:2.0:1790946542.862060:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be0c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+29:10487:x1877943286544128:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:2.0:1790946542.862149:0:6803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93272327 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.862171:0:6803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef932722cc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd85 expref: 29 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.862182:0:6803:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93272327 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.862268:0:6803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef932722cc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd85 expref: 29 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.862284:0:6803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef932722cc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd85 expref: 29 pid: 5834 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946542.862301:0:6803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be84b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6803:1877943303342592:192.168.203.13@tcp:104: 00000100:00100000:2.0:1790946542.862427:0:6803:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146879a9900 going to sleep for 11 seconds 00000100:00100000:3.0:1790946542.865548:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946542.865782:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286544384 00000100:00100000:1.0:1790946542.865795:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286544384 00000100:00100000:1.0:1790946542.865868:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00100000:1.0:1790946542.865880:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5eb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+30:5600:x1877943286544384:12345-192.168.203.13@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1790946542.865990:0:6803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be84b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6803:1877943303342592:192.168.203.13@tcp:104: 00010000:00010000:2.0:1790946542.866020:0:6803:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93272327 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946542.866296:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5eb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+31:5600:x1877943286544384:12345-192.168.203.13@tcp:35:ldlm_bl.0 Request processed in 417us (761us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1790946542.866304:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00100000:1.0:1790946542.873275:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946542.873352:0:5820:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286544512 00000100:00100000:0.0:1790946542.873365:0:5820:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286544512 00010000:00010000:0.0:1790946542.873422:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef932722cc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd85 expref: 31 pid: 5834 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946542.873569:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 48 00000100:00100000:0.0:1790946542.873580:0:5820:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914688713480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+31:2363:x1877943286544512:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790946542.873598:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790946542.873606:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef932722cc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd85 expref: 31 pid: 5834 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946542.873622:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef932722cc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd85 expref: 31 pid: 5834 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946542.873662:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef932722cc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd85 expref: 31 pid: 5834 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946542.873680:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91469e29dc00) 00010000:00010000:0.0:1790946542.873685:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93272327 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946542.873696:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93272327 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946542.873705:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93272327 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946542.873745:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790946542.873809:0:5820:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914688713480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+30:2363:x1877943286544512:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 231us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946542.873816:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 48 00010000:00010000:3.0:1790946542.874587:0:6803:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93272327 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946542.874602:0:6803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93272327 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946542.874645:0:6803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93272327 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946542.874654:0:6803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93272327 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946542.874661:0:6803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93272327 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946542.874669:0:6803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aee600 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946542.874675:0:6803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93272327 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946542.874683:0:6803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93272327 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946542.874697:0:6803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91469e29dc00) 00010000:00010000:3.0:1790946542.874700:0:6803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790946542.874705:0:6803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93272327 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946542.874711:0:6803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93272327 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946542.874877:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be0c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+29:10487:x1877943286544128:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 12817us (13084us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946542.874888:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 93 00000100:00100000:1.0:1790946542.877908:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946542.878081:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286544768 00000100:00100000:2.0:1790946542.878097:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286544768 00000100:00100000:2.0:1790946542.878173:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 23 00000100:00100000:2.0:1790946542.878185:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914688711500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+29:10487:x1877943286544768:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:2.0:1790946542.878896:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914688711500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+30:10487:x1877943286544768:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 708us (998us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1790946542.878907:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 23 00010000:00010000:0.0:1790946542.896471:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1790946542.905236:0:7645:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:1.0:1790946542.905252:0:7645:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:3.0:1790946542.905434:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be05cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+8:2364:x1877943286543744:12345-192.168.203.13@tcp:16:kworker.0 Request processed in 79945us (80360us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946542.905450:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 34 00000100:00100000:1.0:1790946542.981975:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946542.982535:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286545024 00000100:00100000:0.0:1790946542.982550:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286545024 00000100:00100000:0.0:1790946542.982631:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 94 00000100:00100000:0.0:1790946542.982642:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914688713b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+30:10498:x1877943286545024:12345-192.168.203.13@tcp:101:cat.0 00010000:00010000:0.0:1790946542.982682:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946542.982709:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef9327232e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cda1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946542.982820:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef93272335 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946542.982856:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef93272335 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946542.982873:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef93272335 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946542.982893:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef9327233c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946542.982901:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef9327233c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946542.982908:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef9327233c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.991871:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef93272343 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.991900:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef93272343 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.991917:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef93272343 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790946542.991956:0:5834:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:2.0:1790946542.992097:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef93272335 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.992105:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef93272335 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.992112:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef93272335 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.992119:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1933a00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:2.0:1790946542.992125:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef93272335 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.992133:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef93272335 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.992148:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91469e29d100) 00010000:00010000:2.0:1790946542.992151:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790946542.992156:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef93272335 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.992162:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef93272335 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.992179:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef9327233c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.992185:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef9327233c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.992262:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef9327233c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.992268:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1932400 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:2.0:1790946542.992272:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef9327233c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.992278:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef9327233c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.992287:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff914686750d00) 00010000:00010000:2.0:1790946542.992290:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790946542.992293:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef9327233c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.992299:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef9327233c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.992369:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef9327232e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cda1 expref: 33 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.992629:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef93272343 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cda1 expref: 32 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946542.992638:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91469e29dc00) 00010000:00010000:2.0:1790946542.992640:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790946542.992643:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914688aee400, rc 0) 00000100:00100000:2.0:1790946542.992750:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914688713b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+32:10498:x1877943286545024:12345-192.168.203.13@tcp:101:cat.0 Request processed in 10108us (10787us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1790946542.992770:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 94 00000100:00100000:0.0:1790946543.002863:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946543.002958:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286545280 00000100:00100000:3.0:1790946543.002974:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286545280 00000100:00100000:3.0:1790946543.003040:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00100000:3.0:1790946543.003052:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be0c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+32:10498:x1877943286545280:12345-192.168.203.13@tcp:35:cat.0 00000100:00100000:3.0:1790946543.003422:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be0c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+33:10498:x1877943286545280:12345-192.168.203.13@tcp:35:cat.0 Request processed in 370us (572us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1790946543.003431:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00100000:3.0:1790946543.036490:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946543.036619:0:11315:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286545536 00000100:00100000:0.0:1790946543.036632:0:11315:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286545536 00000100:00100000:0.0:1790946543.036711:0:11315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 95 00000100:00100000:0.0:1790946543.036723:0:11315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+33:10499:x1877943286545536:12345-192.168.203.13@tcp:36:rm.0 00010000:00010000:0.0:1790946543.036813:0:11315:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1790946543.036847:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef93272343 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cda1 expref: 33 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.036877:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef93272319 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd9a expref: 32 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.036892:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef932722e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd8c expref: 31 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.036929:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91469e29dc00) 00010000:00010000:0.0:1790946543.036944:0:11315:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790946543.036985:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272351 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.037004:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272351 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.037016:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272351 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.037034:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933400/0x16e41aef93272358 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.037042:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933400/0x16e41aef93272358 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.037049:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933400/0x16e41aef93272358 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.037439:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef9327235f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.037449:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef9327235f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.037458:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef9327235f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790946543.038266:0:11315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:0.0:1790946543.038279:0:11315:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 328110077468ns, next at 329110074653ns, rc = 0 00010000:00010000:0.0:1790946543.038365:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272366 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.038381:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272366 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.038398:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272366 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.038406:0:11315:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272366 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.038412:0:11315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272366 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.038419:0:11315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272366 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.038440:0:11315:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790946543.038466:0:11315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef9327235f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.038473:0:11315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef9327235f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.038480:0:11315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef9327235f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.038487:0:11315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1933200 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:0.0:1790946543.038492:0:11315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef9327235f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.038501:0:11315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef9327235f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.038522:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff914686750200) 00010000:00010000:0.0:1790946543.038525:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1790946543.038531:0:11315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef9327235f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.038538:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef9327235f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.038558:0:11315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272351 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.038564:0:11315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272351 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.038570:0:11315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272351 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.038576:0:11315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1933800 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:0.0:1790946543.038579:0:11315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272351 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.038585:0:11315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272351 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.038593:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91469e29d100) 00010000:00010000:0.0:1790946543.038596:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790946543.038599:0:11315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272351 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.038605:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272351 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790946543.038628:0:11315:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000a994bff4 reply state 000000007d7c9b6a transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933400/0x16e41aef93272358 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946543.038638:0:11315:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790946543.038760:0:11315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+32:10499:x1877943286545536:12345-192.168.203.13@tcp:36:rm.0 Request processed in 2036us (2281us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1790946543.038771:0:11315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 95 00010000:00010000:2.0:1790946543.039313:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946543.039324:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272366 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.039333:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1932800 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:2.0:1790946543.039336:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272366 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.039343:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272366 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.039356:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff914686750200) 00010000:00010000:2.0:1790946543.039360:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1790946543.039364:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272366 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.039370:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272366 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.039392:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946543.039394:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946543.039395:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946543.041541:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933400/0x16e41aef93272358 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.041565:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933400/0x16e41aef93272358 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.041573:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933400/0x16e41aef93272358 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.041580:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1933400 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946543.041585:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933400/0x16e41aef93272358 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.041617:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933400/0x16e41aef93272358 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.041635:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff914686750b00) 00010000:00010000:3.0:1790946543.041639:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946543.041644:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933400/0x16e41aef93272358 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.041651:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933400/0x16e41aef93272358 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946543.089833:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946543.098130:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286545792 00000100:00100000:0.0:1790946543.098148:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286545792 00000100:00100000:0.0:1790946543.098253:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 96 00000100:00100000:0.0:1790946543.098265:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5fdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+31:10505:x1877943286545792:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:0.0:1790946543.098296:0:6803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946543.098321:0:6803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef9327236d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cda8 expref: -99 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.098709:0:6803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef93272374 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.098798:0:6803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef93272374 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.098813:0:6803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef93272374 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.098830:0:6803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef9327237b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.098838:0:6803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef9327237b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.098863:0:6803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef9327237b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790946543.104771:0:6803:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1790946543.105178:0:6803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933400/0x16e41aef93272382 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.105294:0:6803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933400/0x16e41aef93272382 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.107409:0:6803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933400/0x16e41aef93272382 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.107534:0:6803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef93272374 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.107545:0:6803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef93272374 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.107554:0:6803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef93272374 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.107561:0:6803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1933200 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:0.0:1790946543.107567:0:6803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef93272374 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.107575:0:6803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef93272374 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.107593:0:6803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91469e29d100) 00010000:00010000:0.0:1790946543.107596:0:6803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790946543.107620:0:6803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef93272374 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.107627:0:6803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef93272374 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790946543.107645:0:6803:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000027e74773 reply state 000000002190cb1b transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef9327237b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946543.107656:0:6803:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790946543.107714:0:6803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef9327236d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cda8 expref: 34 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.107742:0:6803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933400/0x16e41aef93272382 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cda8 expref: 33 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.107752:0:6803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff914686750600) 00010000:00010000:0.0:1790946543.107754:0:6803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790946543.107757:0:6803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b1933400, rc 0) 00000100:00100000:0.0:1790946543.107865:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5fdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+34:10505:x1877943286545792:12345-192.168.203.13@tcp:101:bash.0 Request processed in 9600us (18046us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1790946543.107874:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 96 00010000:00010000:0.0:1790946543.110567:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef9327237b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.110588:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef9327237b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.110596:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef9327237b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.110623:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1933a00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:0.0:1790946543.110628:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef9327237b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.110637:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef9327237b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.110656:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff914686750900) 00010000:00010000:0.0:1790946543.110659:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790946543.110664:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef9327237b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.110671:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef9327237b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946543.112532:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946543.119316:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286545920 00000100:00100000:2.0:1790946543.119333:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286545920 00000100:00100000:2.0:1790946543.119423:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 35 00000100:00100000:2.0:1790946543.119433:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682eafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+7:2363:x1877943286545920:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:2.0:1790946543.119451:0:6673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946543.119472:0:6673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021fcc3a6/0x16e41aef93272390 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cdaf expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790946543.119652:0:6673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790946543.119672:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=328s v=(0 0) 00010000:00010000:2.0:1790946543.119677:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790946543.119687:0:6673:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021fcc3a6/0x16e41aef93272390 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cdaf expref: 8 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.119705:0:6673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000021fcc3a6/0x16e41aef93272390 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cdaf expref: 8 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.119718:0:6673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914688aefa00, rc 0) 00000100:00100000:2.0:1790946543.119788:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682eafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+8:2363:x1877943286545920:12345-192.168.203.13@tcp:101:bash.0 Request processed in 356us (7269us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946543.119795:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 35 00000100:00080000:0.0:1790946543.119994:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790946543.129990:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946543.130093:0:6808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286546048 00000100:00100000:0.0:1790946543.130107:0:6808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286546048 00000100:00100000:0.0:1790946543.130170:0:6808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 36 00000100:00100000:0.0:1790946543.130180:0:6808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682eaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+8:10505:x1877943286546048:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:0.0:1790946543.130224:0:6808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946543.130246:0:6808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b0a99b5/0x16e41aef93272397 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cdb6 expref: -99 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.130283:0:6808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000021fcc3a6/0x16e41aef93272390 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cdaf expref: 9 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.130293:0:6808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946543.130309:0:6808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946543.130316:0:6808:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b0a99b5/0x16e41aef93272397 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cdb6 expref: 9 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.130358:0:6808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000021fcc3a6/0x16e41aef93272390 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cdaf expref: 9 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.130374:0:6808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000021fcc3a6/0x16e41aef93272390 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cdaf expref: 9 pid: 6673 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946543.130405:0:6808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be0c6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6808:1877943303342720:192.168.203.13@tcp:104: 00000100:00100000:0.0:1790946543.130588:0:6808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146c1c9fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1790946543.136790:0:6808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be0c6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6808:1877943303342720:192.168.203.13@tcp:104: 00010000:00010000:0.0:1790946543.136844:0:6808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000b0a99b5/0x16e41aef93272397 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cdb6 expref: 9 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.136871:0:6808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b1933800, rc 0) 00000100:00100000:0.0:1790946543.136946:0:6808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682eaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+9:10505:x1877943286546048:12345-192.168.203.13@tcp:101:bash.0 Request processed in 6765us (6968us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946543.136956:0:6808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 36 00000100:00100000:3.0:1790946543.140767:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946543.140914:0:5819:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286546176 00000100:00100000:1.0:1790946543.140928:0:5819:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286546176 00010000:00010000:1.0:1790946543.140983:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000021fcc3a6/0x16e41aef93272390 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cdaf expref: 9 pid: 6673 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946543.141107:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 49 00000100:00100000:1.0:1790946543.141120:0:5819:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914685712850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+9:2364:x1877943286546176:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790946543.141139:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790946543.141167:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000021fcc3a6/0x16e41aef93272390 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cdaf expref: 9 pid: 6673 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946543.141222:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000021fcc3a6/0x16e41aef93272390 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cdaf expref: 9 pid: 6673 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946543.141252:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021fcc3a6/0x16e41aef93272390 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cdaf expref: 9 pid: 6673 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946543.141271:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946543.141276:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946543.141293:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000b0a99b5/0x16e41aef93272397 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cdb6 expref: 8 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946543.141307:0:5819:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b0a99b5/0x16e41aef93272397 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cdb6 expref: 8 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946543.141356:0:5819:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000b0a99b5/0x16e41aef93272397 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cdb6 expref: 8 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946543.141375:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914688710700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5819:1877943303342848:192.168.203.13@tcp:105: 00000100:00100000:1.0:1790946543.142320:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set ffff914682b45300 going to sleep for 11 seconds 00000100:00100000:2.0:1790946543.150783:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914688710700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5819:1877943303342848:192.168.203.13@tcp:105: 00000100:00100000:0.0:1790946543.150783:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00010000:00010000:2.0:1790946543.150813:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790946543.150821:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286546432 00000100:00100000:0.0:1790946543.150829:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286546432 00000100:00100000:2.0:1790946543.150879:0:5819:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914685712850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+8:2364:x1877943286546176:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 9762us (10126us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946543.150885:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 25 00000100:00100000:2.0:1790946543.150889:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 49 00000100:00100000:0.0:1790946543.150894:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be0c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+33:10505:x1877943286546432:12345-192.168.203.13@tcp:35:bash.0 00000100:00100000:0.0:1790946543.151768:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be0c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+34:10505:x1877943286546432:12345-192.168.203.13@tcp:35:bash.0 Request processed in 871us (988us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1790946543.151786:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 25 00000001:00080000:2.0:1790946543.156187:0:6700:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00080000:2.0:1790946543.156245:0:6700:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00080000:2.0:1790946543.156252:0:6700:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:1.0:1790946543.298147:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946543.302469:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286546560 00000100:00100000:2.0:1790946543.302491:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286546560 00000100:00100000:2.0:1790946543.302602:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 97 00000100:00100000:2.0:1790946543.302615:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914688710380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+34:10522:x1877943286546560:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1790946543.302668:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946543.302708:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef9327239e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cdbd expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.303096:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef932723a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.303116:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef932723a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.303142:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef932723a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790946543.303198:0:5834:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1790946543.303227:0:5834:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790946543.303253:0:5834:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef932723a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.303285:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef9327239e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cdbd expref: 36 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.303308:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef932723a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cdbd expref: 35 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.303318:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91469e29d100) 00010000:00010000:2.0:1790946543.303321:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790946543.303325:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914688aefc00, rc 0) 00000100:00100000:2.0:1790946543.303431:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914688710380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+35:10522:x1877943286546560:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 818us (5298us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946543.303440:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 97 00000100:00100000:2.0:1790946543.311775:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946543.313631:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286546816 00000100:00100000:3.0:1790946543.313653:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286546816 00000100:00100000:3.0:1790946543.313766:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 98 00000100:00100000:3.0:1790946543.313779:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be84bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+35:10522:x1877943286546816:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1790946543.313807:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946543.313835:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032be00/0x16e41aef932723ac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cdc4 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.313964:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a200/0x16e41aef932723b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.313981:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a200/0x16e41aef932723b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.314019:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a200/0x16e41aef932723b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790946543.314034:0:5835:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1790946543.314268:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032be00/0x16e41aef932723ac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cdc4 expref: 38 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.314291:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a200/0x16e41aef932723b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cdc4 expref: 37 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.314301:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff914686750600) 00010000:00010000:3.0:1790946543.314305:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790946543.314309:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146a032a200, rc 0) 00000100:00100000:3.0:1790946543.318677:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be84bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+37:10522:x1877943286546816:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 4882us (6897us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1790946543.318694:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 98 00000100:00100000:0.0:1790946543.327603:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946543.327805:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946543.328020:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286547200 00000100:00100000:3.0:1790946543.328031:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286547200 00000100:00100000:3.0:1790946543.328090:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 99 00000100:00100000:3.0:1790946543.328100:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be0c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+37:10522:x1877943286547200:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1790946543.328123:0:6803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946543.328143:0:6803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032be00/0x16e41aef932723c1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cdcb expref: -99 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.328273:0:6803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef932723c8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.328379:0:6803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef932723c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.328390:0:6803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef932723c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790946543.328404:0:6803:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1790946543.328620:0:6803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032be00/0x16e41aef932723c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cdcb expref: 40 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.328641:0:6803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef932723c8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cdcb expref: 39 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.328651:0:6803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff914686750600) 00010000:00010000:3.0:1790946543.328655:0:6803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1790946543.328659:0:6803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146a032a800, rc 0) 00000100:00100000:3.0:1790946543.328719:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be0c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+39:10522:x1877943286547200:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 619us (912us total) trans 4294967380 rc 0/0 00000100:00100000:3.0:1790946543.328738:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 99 00000100:00100000:2.0:1790946543.328763:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946543.328913:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946543.328946:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286547456 00000100:00100000:2.0:1790946543.328955:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286547456 00000100:00100000:2.0:1790946543.329016:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 136 00000100:00100000:2.0:1790946543.329027:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be84aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+5:2364:x1877943286547456:12345-192.168.203.13@tcp:400:kworker.0 00000100:00080000:0.0:1790946543.329054:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790946543.329102:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be84aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+5:2364:x1877943286547456:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 74us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946543.329113:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 136 00000100:00100000:3.0:1790946543.330063:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286547328 00000100:00100000:3.0:1790946543.332019:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286547328 00000100:00100000:3.0:1790946543.332085:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 290 00000100:00100000:3.0:1790946543.332093:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:2364:x1877943286547328:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790946543.332166:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:2364:x1877943286547328:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 73us (3412us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946543.332174:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 290 00000100:00100000:1.0:1790946543.334105:0:5821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286546944 00000100:00100000:1.0:1790946543.334117:0:5821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286546944 00000100:00100000:1.0:1790946543.334180:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:1.0:1790946543.334190:0:5821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be0c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+39:2363:x1877943286546944:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790946543.334242:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790946543.334265:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a200/0x16e41aef932723b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cdc4 expref: 39 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946543.334294:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff914686750600) 00010000:00010000:1.0:1790946543.334299:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790946543.334344:0:5821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be0c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+38:2363:x1877943286546944:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 156us (6819us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946543.334351:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:0.0:1790946543.338957:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946543.339164:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286547584 00000100:00100000:2.0:1790946543.339174:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286547584 00000100:00100000:2.0:1790946543.339389:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 37 00000100:00100000:2.0:1790946543.339400:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be0c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2363:x1877943286547584:12345-192.168.203.13@tcp:1:lfs.0 00010000:00010000:2.0:1790946543.339509:0:6673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008786149f/0x16e41aef932723d6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.339530:0:6673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000b0a99b5/0x16e41aef93272397 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cdb6 expref: 6 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.339538:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790946543.339542:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790946543.339547:0:6673:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008786149f/0x16e41aef932723d6 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.339582:0:6673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000b0a99b5/0x16e41aef93272397 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cdb6 expref: 6 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.339614:0:6673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000b0a99b5/0x16e41aef93272397 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cdb6 expref: 6 pid: 6808 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946543.339628:0:6673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be84b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6673:1877943303342976:192.168.203.13@tcp:104: 00000100:00100000:2.0:1790946543.339708:0:6673:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146879a9300 going to sleep for 11 seconds 00000100:00100000:3.0:1790946543.343824:0:6673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be84b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6673:1877943303342976:192.168.203.13@tcp:104: 00010000:00010000:3.0:1790946543.343883:0:6673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008786149f/0x16e41aef932723d6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946543.344978:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946543.345081:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286547712 00000100:00100000:3.0:1790946543.345092:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286547712 00002000:00100000:3.0:1790946543.345156:0:6679:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9146be0c4000 x1877943286547712/t0(0) o4->7eed1f4b-bd5b-4a70-8045-59db065b3dfc@192.168.203.13@tcp:484/0 lens 504/0 e 0 to 0 dl 1790946554 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790946543.345169:0:6679:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9146be0c4000 with x1877943286547712 ext(0->8) 00010000:00010000:3.0:1790946543.345180:0:6679:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000000b0a99b5/0x16e41aef93272397 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cdb6 expref: 7 pid: 6808 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.345233:0:6679:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000000b0a99b5/0x16e41aef93272397 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cdb6 expref: 7 pid: 6808 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790946543.345245:0:6679:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9146be0c4000 00000100:00100000:3.0:1790946543.345278:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 1 00000100:00100000:3.0:1790946543.345289:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be0c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+7:2364:x1877943286547712:12345-192.168.203.13@tcp:4:lfs.0 00000100:00100000:3.0:1790946543.345906:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be0c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+9:2364:x1877943286547712:12345-192.168.203.13@tcp:4:lfs.0 Request processed in 615us (932us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1790946543.345915:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 1 00002000:00100000:3.0:1790946543.345924:0:6679:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9146be0c4000 x1877943286547712/t4294967302(0) o4->7eed1f4b-bd5b-4a70-8045-59db065b3dfc@192.168.203.13@tcp:484/0 lens 504/448 e 0 to 0 dl 1790946554 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790946543.345933:0:6679:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9146be0c4000 with x1877943286547712 ext(0->8) 00010000:00010000:3.0:1790946543.345939:0:6679:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000000b0a99b5/0x16e41aef93272397 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cdb6 expref: 9 pid: 6808 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.345963:0:6679:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000000b0a99b5/0x16e41aef93272397 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cdb6 expref: 9 pid: 6808 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790946543.345972:0:6679:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9146be0c4000 00000100:00100000:0.0:1790946543.348664:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946543.349116:0:5819:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286547840 00000100:00100000:2.0:1790946543.349130:0:5819:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286547840 00010000:00010000:2.0:1790946543.349182:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000b0a99b5/0x16e41aef93272397 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cdb6 expref: 9 pid: 6808 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946543.349274:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 50 00000100:00100000:2.0:1790946543.349286:0:5819:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be0c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+9:2364:x1877943286547840:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790946543.349306:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1790946543.349331:0:5819:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1790946543.349335:0:5819:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1790946542 00002000:00010000:2.0:1790946543.349338:0:5819:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1790946542 00002000:00010000:2.0:1790946543.349340:0:5819:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1790946542 00010000:00010000:2.0:1790946543.349348:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000b0a99b5/0x16e41aef93272397 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cdb6 expref: 9 pid: 6808 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.349363:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000b0a99b5/0x16e41aef93272397 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cdb6 expref: 9 pid: 6808 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.349401:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b0a99b5/0x16e41aef93272397 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cdb6 expref: 9 pid: 6808 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.349441:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790946543.349447:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790946543.349454:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008786149f/0x16e41aef932723d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.349465:0:5819:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008786149f/0x16e41aef932723d6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.349503:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790946543.349578:0:5819:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be0c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+8:2364:x1877943286547840:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 293us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946543.349587:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 50 00010000:00010000:3.0:1790946543.349668:0:6673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008786149f/0x16e41aef932723d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.349680:0:6673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008786149f/0x16e41aef932723d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.349712:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008786149f/0x16e41aef932723d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.349739:0:6673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008786149f/0x16e41aef932723d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.349750:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008786149f/0x16e41aef932723d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.349758:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aef800 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:3.0:1790946543.349763:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008786149f/0x16e41aef932723d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.349774:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008786149f/0x16e41aef932723d6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.349800:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008786149f/0x16e41aef932723d6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.349809:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008786149f/0x16e41aef932723d6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946543.349883:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be0c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+7:2363:x1877943286547584:12345-192.168.203.13@tcp:1:lfs.0 Request processed in 10485us (10934us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946543.349892:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 37 00000100:00100000:0.0:1790946543.356094:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946543.356179:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286548096 00000100:00100000:3.0:1790946543.356191:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286548096 00000100:00100000:3.0:1790946543.356295:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 26 00000100:00100000:3.0:1790946543.356305:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b2651050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+38:10522:x1877943286548096:12345-192.168.203.13@tcp:35:lfs.0 00000004:00010000:3.0:1790946543.356391:0:5837:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef932723c8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cdcb expref: 38 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790946543.356701:0:5837:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:3.0:1790946543.356753:0:5837:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:3.0:1790946543.357107:0:5837:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967383 00010000:00010000:3.0:1790946543.357173:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef932723dd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.357193:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933400/0x16e41aef93272382 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cda8 expref: 42 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.357254:0:5837:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef932723dd lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.357317:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933400/0x16e41aef93272382 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cda8 expref: 42 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.357334:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933400/0x16e41aef93272382 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cda8 expref: 42 pid: 6803 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946543.357352:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee95c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5837:1877943303343104:192.168.203.13@tcp:104: 00000100:00100000:3.0:1790946543.357453:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff91469e292b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790946543.361180:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946543.361315:0:5820:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286548224 00000100:00100000:0.0:1790946543.361328:0:5820:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286548224 00010000:00010000:0.0:1790946543.361378:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933400/0x16e41aef93272382 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cda8 expref: 43 pid: 6803 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946543.361426:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 51 00000100:00100000:0.0:1790946543.361437:0:5820:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be848380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+43:2364:x1877943286548224:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790946543.361459:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790946543.361467:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933400/0x16e41aef93272382 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cda8 expref: 43 pid: 6803 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.361482:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933400/0x16e41aef93272382 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cda8 expref: 43 pid: 6803 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.361507:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff914686750600) 00010000:00010000:0.0:1790946543.361514:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef932723dd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.361525:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef932723dd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.361551:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef932723dd lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.361573:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790946543.361651:0:5820:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be848380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+43:2364:x1877943286548224:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 215us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946543.361660:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 51 00010000:00010000:3.0:1790946543.361830:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933400/0x16e41aef93272382 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cda8 expref: 42 pid: 6803 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946543.361860:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee95c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5837:1877943303343104:192.168.203.13@tcp:104: 00010000:00010000:3.0:1790946543.361887:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef932723dd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.361896:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef932723dd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.361903:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef932723dd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790946543.362059:0:5837:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967384 00000001:00080000:3.0:1790946543.362355:0:5837:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:3.0:1790946543.362496:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee95c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5837:1877943303343232:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1790946543.362577:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946543.362611:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff91458665fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1790946543.363225:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303343232 00000100:00100000:0.0:1790946543.363235:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303343232 00000100:00100000:0.0:1790946543.363308:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790946543.363318:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5837:x1877943303343232:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1790946543.363438:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5837:x1877943303343232:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 121us (860us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946543.363446:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790946543.363492:0:5837:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:0.0:1790946543.363499:0:5837:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:0.0:1790946543.363524:0:5837:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9146c1cf8000, transno 4294967301 00000100:00100000:0.0:1790946543.363538:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee95c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5837:1877943303343232:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1790946543.364167:0:5837:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:0.0:1790946543.364280:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b631b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5837:1877943303343360:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1790946543.364328:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946543.364365:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303343360 00000100:00100000:0.0:1790946543.364371:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303343360 00000100:00100000:1.0:1790946543.364736:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff91469e292b40 going to sleep for 11 seconds 00000100:00080000:2.0:1790946543.364793:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790946543.364911:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790946543.364923:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b6319c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5837:x1877943303343360:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1790946543.365236:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b6319c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5837:x1877943303343360:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 315us (906us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1790946543.365253:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790946543.365989:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b631b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5837:1877943303343360:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1790946543.366088:0:5837:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1790946543.366148:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef932723dd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946543.366160:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef932723dd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946543.366168:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef932723dd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946543.366174:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146a032a400 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:1.0:1790946543.366180:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef932723dd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946543.366188:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef932723dd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946543.366220:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff914686750600) 00010000:00010000:1.0:1790946543.366618:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1790946543.366627:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef932723dd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946543.366634:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef932723dd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790946543.367476:0:5837:0:(mdd_object.c:4180:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1790946543.367634:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:1.0:1790946543.367712:0:5837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 328439446165ns, next at 329439443142ns, rc = 0 00000001:00080000:1.0:1790946543.367732:0:5837:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:1.0:1790946543.367792:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff914686750600) 00010000:00010000:1.0:1790946543.367796:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1790946543.367808:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef932723c8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cdcb expref: 46 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946543.367979:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b2651050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+45:10522:x1877943286548096:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 11673us (11898us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1790946543.367990:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 26 00000020:00080000:1.0:1790946543.367996:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1790946543.371035:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946543.371514:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286548352 00000100:00100000:3.0:1790946543.371542:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286548352 00000100:00100000:3.0:1790946543.371612:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 100 00000100:00100000:3.0:1790946543.371622:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be848000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+45:10522:x1877943286548352:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1790946543.371659:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946543.371910:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032be00/0x16e41aef932723e4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cdd2 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.371993:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032be00/0x16e41aef932723e4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cdd2 expref: 46 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.372008:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032be00/0x16e41aef932723e4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cdd2 expref: 46 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.372027:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9146836df700) 00010000:00010000:3.0:1790946543.372031:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790946543.372034:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146a032be00, rc 0) 00000100:00100000:3.0:1790946543.372113:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be848000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+46:10522:x1877943286548352:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 492us (1091us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946543.372121:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 100 00000100:00100000:0.0:1790946543.379027:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946543.379139:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286548608 00000100:00100000:2.0:1790946543.379152:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286548608 00000100:00100000:2.0:1790946543.379252:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 27 00000100:00100000:2.0:1790946543.379264:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beee5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+46:10522:x1877943286548608:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:2.0:1790946543.379645:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beee5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+47:10522:x1877943286548608:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 381us (631us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1790946543.379654:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 27 00000100:00100000:2.0:1790946543.447097:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946543.447227:0:11315:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286548736 00000100:00100000:0.0:1790946543.447241:0:11315:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286548736 00000100:00100000:0.0:1790946543.447313:0:11315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 101 00000100:00100000:0.0:1790946543.447324:0:11315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be84b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+47:10532:x1877943286548736:12345-192.168.203.13@tcp:34:lfs.0 00010000:00010000:0.0:1790946543.447524:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef932723eb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.447547:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef932723eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.447560:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef932723eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.447577:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef932723f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.447585:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef932723f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.447592:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef932723f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.447703:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef932723f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.447711:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef932723f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.447790:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef932723f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790946543.448031:0:11315:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef932723f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.448048:0:11315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef932723eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.448055:0:11315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef932723eb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.448064:0:11315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef932723eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.448071:0:11315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1933a00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:0.0:1790946543.448076:0:11315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef932723eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.448084:0:11315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef932723eb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.448097:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91469e29d100) 00010000:00010000:0.0:1790946543.448101:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790946543.448106:0:11315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef932723eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.448113:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef932723eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.448131:0:11315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef932723f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.448137:0:11315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef932723f2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.448150:0:11315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef932723f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.448155:0:11315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1933200 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:0.0:1790946543.448158:0:11315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef932723f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.448165:0:11315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef932723f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.448172:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff914686750900) 00010000:00010000:0.0:1790946543.448175:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790946543.448177:0:11315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef932723f2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.448183:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef932723f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.448252:0:11315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef932723f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.448260:0:11315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef932723f9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.448264:0:11315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef932723f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.448269:0:11315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1932800 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:0.0:1790946543.448271:0:11315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef932723f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.448287:0:11315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef932723f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.448295:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9146836df700) 00010000:00010000:0.0:1790946543.448298:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790946543.448300:0:11315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef932723f9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.448305:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef932723f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946543.448659:0:11315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be84b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+47:10532:x1877943286548736:12345-192.168.203.13@tcp:34:lfs.0 Request processed in 1333us (1570us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946543.448671:0:11315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 101 00000100:00100000:3.0:1790946543.478979:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946543.479781:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286548992 00000100:00100000:2.0:1790946543.479797:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286548992 00000100:00100000:2.0:1790946543.480063:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 102 00000100:00100000:2.0:1790946543.480075:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+47:10535:x1877943286548992:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1790946543.480106:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946543.480134:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef93272400 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cdd9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.480271:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef93272407 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.480289:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef93272407 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.480302:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef93272407 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.480318:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef9327240e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.480325:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef9327240e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.480332:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef9327240e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.480690:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef93272415 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.480701:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef93272415 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.480709:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef93272415 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790946543.480800:0:5836:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1790946543.480995:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef93272407 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.481004:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef93272407 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.481012:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef93272407 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.481018:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aef200 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:2.0:1790946543.481022:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef93272407 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.481030:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef93272407 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.481043:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91469e29d100) 00010000:00010000:2.0:1790946543.481047:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790946543.481052:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef93272407 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.481058:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef93272407 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.481073:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef9327240e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.481079:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef9327240e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.481094:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef9327240e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.481099:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aef000 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:2.0:1790946543.481102:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef9327240e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.481108:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef9327240e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.481115:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9146a0a5e000) 00010000:00010000:2.0:1790946543.481117:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790946543.481119:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef9327240e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.481124:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef9327240e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.481173:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef93272400 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cdd9 expref: 50 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.481189:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef93272415 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cdd9 expref: 49 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.481196:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9146836df700) 00010000:00010000:2.0:1790946543.481308:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790946543.481313:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914688aee000, rc 0) 00000100:00100000:2.0:1790946543.481580:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+49:10535:x1877943286548992:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 1506us (2613us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1790946543.481600:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 102 00000100:00100000:0.0:1790946543.485905:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946543.485987:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286549120 00000100:00100000:3.0:1790946543.486001:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286549120 00000100:00100000:3.0:1790946543.486106:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 103 00000100:00100000:3.0:1790946543.486118:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beee4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+49:10535:x1877943286549120:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:3.0:1790946543.486249:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93272423 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.486272:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93272423 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.486306:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93272423 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.486341:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93272423 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.486349:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93272423 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.486357:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93272423 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.486363:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146a032b400 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946543.486368:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93272423 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.486375:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93272423 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.486402:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9146836df700) 00010000:00010000:3.0:1790946543.486405:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790946543.486411:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93272423 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.486417:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93272423 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946543.486506:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beee4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+49:10535:x1877943286549120:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 389us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946543.486515:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 103 00000100:00100000:0.0:1790946543.489122:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946543.489484:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286549376 00000100:00100000:2.0:1790946543.489497:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286549376 00000100:00100000:2.0:1790946543.489599:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 28 00000100:00100000:2.0:1790946543.489612:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beee4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+49:10535:x1877943286549376:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:2.0:1790946543.490109:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beee4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+50:10535:x1877943286549376:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 497us (997us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1790946543.490117:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 28 00000100:00100000:0.0:1790946543.581475:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946543.581637:0:11315:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286549632 00000100:00100000:3.0:1790946543.581668:0:11315:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286549632 00000100:00100000:3.0:1790946543.581749:0:11315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 104 00000100:00100000:3.0:1790946543.581759:0:11315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+50:10545:x1877943286549632:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:3.0:1790946543.581792:0:11315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946543.581797:0:11315:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1790946543.581831:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef932723a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cdbd expref: 50 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.582166:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91469e29d100) 00010000:00010000:3.0:1790946543.582172:0:11315:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790946543.582191:0:11315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef9327242a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cde0 expref: -99 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.582364:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93272431 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.582381:0:11315:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef93272415 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cdd9 expref: 50 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.582390:0:11315:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93272431 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.582432:0:11315:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef93272415 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cdd9 expref: 50 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.582448:0:11315:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef93272415 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cdd9 expref: 50 pid: 5836 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946543.582465:0:11315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee94e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11315:1877943303343488:192.168.203.13@tcp:104: 00000100:00100000:3.0:1790946543.582586:0:11315:0:(client.c:2716:ptlrpc_set_wait()) set ffff91458665fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1790946543.590766:0:11315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee94e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11315:1877943303343488:192.168.203.13@tcp:104: 00010000:00010000:3.0:1790946543.590807:0:11315:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93272431 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946543.591645:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946543.592043:0:5819:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286549760 00000100:00100000:2.0:1790946543.592054:0:5819:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286549760 00010000:00010000:2.0:1790946543.592105:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef93272415 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cdd9 expref: 51 pid: 5836 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946543.592152:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 52 00000100:00100000:2.0:1790946543.592164:0:5819:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914685636d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+51:2364:x1877943286549760:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790946543.592184:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790946543.592191:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef93272415 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cdd9 expref: 51 pid: 5836 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.592244:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef93272415 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cdd9 expref: 51 pid: 5836 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.592271:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef93272415 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cdd9 expref: 51 pid: 5836 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.592292:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9146836df700) 00010000:00010000:2.0:1790946543.592317:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93272431 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.592329:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93272431 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.592338:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93272431 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.592374:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790946543.592473:0:11315:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93272431 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.592483:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93272431 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790946543.592507:0:11315:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1790946543.592704:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef9327242a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cde0 expref: 52 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.592740:0:11315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93272431 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cde0 expref: 51 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.592749:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9146836df700) 00010000:00010000:3.0:1790946543.592752:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790946543.592754:0:11315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146a032bc00, rc 0) 00000100:00100000:3.0:1790946543.592847:0:11315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+51:10545:x1877943286549632:12345-192.168.203.13@tcp:101:bash.0 Request processed in 11081us (11378us total) trans 4294967393 rc 0/0 00000100:00100000:3.0:1790946543.592857:0:11315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 104 00000100:00100000:2.0:1790946543.592977:0:5819:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914685636d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+50:2364:x1877943286549760:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 814us (1337us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946543.592986:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 52 00000100:00100000:0.0:1790946543.596786:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946543.597038:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286550016 00000100:00100000:2.0:1790946543.597052:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286550016 00000100:00100000:2.0:1790946543.597129:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 105 00000100:00100000:2.0:1790946543.597140:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914685634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+50:10545:x1877943286550016:12345-192.168.203.13@tcp:36:bash.0 00010000:00010000:2.0:1790946543.597660:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef9327243f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.597683:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef9327243f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.597697:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef9327243f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790946543.597779:0:5836:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967394 00000004:00010000:2.0:1790946543.597808:0:5836:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000012ff5af reply state 0000000084128bc1 transno 4294967395 ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef9327243f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946543.597819:0:5836:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790946543.598318:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914685634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+53:10545:x1877943286550016:12345-192.168.203.13@tcp:36:bash.0 Request processed in 1175us (1542us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1790946543.598328:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 105 00000020:00080000:2.0:1790946543.598334:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1790946543.600965:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1877943303343744:0@lo:400:kworker.0 00000100:00100000:1.0:1790946543.600996:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3300:1877943303343616:0@lo:400:kworker.0 00010000:00010000:0.0:1790946543.601052:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef9327243f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.601067:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef9327243f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.601076:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef9327243f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.601083:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aef800 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:0.0:1790946543.601088:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef9327243f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.601114:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef9327243f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.601134:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9146836df700) 00000100:00100000:3.0:1790946543.601191:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946543.601197:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946543.601263:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146befb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303344128:0@lo:400:kworker.0 00000100:00100000:3.0:1790946543.601287:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303343744 00000100:00100000:1.0:1790946543.601295:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946543.601298:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303343744 00000100:00100000:1.0:1790946543.601331:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303344128 00000100:00100000:1.0:1790946543.601337:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303344128 00000100:00100000:3.0:1790946543.601382:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1790946543.601388:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1790946543.601395:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146befb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1877943303343744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946543.601458:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146befb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1877943303343744:12345-0@lo:400:kworker.0 Request processed in 66us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946543.601464:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914688711500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303344128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946543.601470:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1790946543.601521:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1877943303343744:0@lo:400:kworker.0 00000100:00100000:1.0:1790946543.601523:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914688711500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303344128:12345-0@lo:400:kworker.0 Request processed in 63us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946543.601536:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1790946543.601559:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790946543.601580:0:3300:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000100:00100000:3.0:1790946543.601586:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303343616 00000004:00080000:1.0:1790946543.601588:0:3300:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967305 00000100:00100000:3.0:1790946543.601592:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303343616 00000100:00100000:1.0:1790946543.601615:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146befb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303344128:0@lo:400:kworker.0 00000100:00100000:3.0:1790946543.601628:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1790946543.601637:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3300:x1877943303343616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946543.601692:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3300:x1877943303343616:12345-0@lo:400:kworker.0 Request processed in 56us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946543.601698:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1790946543.601741:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146befb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1877943303344000:0@lo:400:kworker.0 00000100:00100000:3.0:1790946543.601769:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946543.601790:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790946543.601797:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1877943303343872:0@lo:400:kworker.0 00000100:00100000:3.0:1790946543.601819:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946543.601938:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3300:1877943303343616:0@lo:400:kworker.0 00000100:00100000:3.0:1790946543.601949:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946543.601976:0:11315:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303344000 00000100:00100000:3.0:1790946543.601980:0:11315:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303344000 00000100:00080000:3.0:1790946543.601999:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790946543.602019:0:11315:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303343872 00000100:00100000:3.0:1790946543.602023:0:11315:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303343872 00000100:00080000:3.0:1790946543.602044:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790946543.602105:0:11315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1790946543.602115:0:11315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146befb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877943303344000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946543.602119:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286550144 00000100:00100000:3.0:1790946543.602124:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286550144 00000100:00100000:3.0:1790946543.602160:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1790946543.602171:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1877943303343872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946543.602171:0:11315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146befb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877943303344000:12345-0@lo:400:kworker.0 Request processed in 56us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946543.602234:0:11315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1790946543.602247:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1877943303343872:12345-0@lo:400:kworker.0 Request processed in 79us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946543.602256:0:11315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 106 00000100:00100000:2.0:1790946543.602264:0:11315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be075500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+53:10545:x1877943286550144:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:2.0:1790946543.602284:0:11315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946543.602295:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790946543.602309:0:11315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef93272446 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cde7 expref: -99 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.602309:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef9327243f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946543.602329:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef9327243f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.602426:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef9327244d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.602442:0:11315:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93272431 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cde0 expref: 53 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.602451:0:11315:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef9327244d lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.602485:0:11315:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93272431 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cde0 expref: 53 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.602500:0:11315:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93272431 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cde0 expref: 53 pid: 11315 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946543.602521:0:11315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be849500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11315:1877943303344256:192.168.203.13@tcp:104: 00000100:00100000:3.0:1790946543.602825:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1790946543.602869:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1877943303343872:0@lo:400:kworker.0 00000100:00100000:3.0:1790946543.602881:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146befb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1877943303344000:0@lo:400:kworker.0 00000100:00100000:2.0:1790946543.603150:0:11315:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146879a9540 going to sleep for 11 seconds 00000100:00100000:1.0:1790946543.606973:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946543.607144:0:5821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286550272 00000100:00100000:2.0:1790946543.607282:0:11315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be849500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11315:1877943303344256:192.168.203.13@tcp:104: 00010000:00010000:2.0:1790946543.607317:0:11315:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef9327244d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946543.607370:0:5821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286550272 00010000:00010000:3.0:1790946543.607419:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93272431 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cde0 expref: 54 pid: 11315 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946543.607463:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 53 00000100:00100000:3.0:1790946543.607474:0:5821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914688711180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+54:2364:x1877943286550272:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790946543.607491:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790946543.607499:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93272431 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cde0 expref: 54 pid: 11315 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.607512:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93272431 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cde0 expref: 54 pid: 11315 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.607539:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93272431 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cde0 expref: 54 pid: 11315 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.607555:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9146836df700) 00010000:00010000:3.0:1790946543.607561:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef9327244d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.607590:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef9327244d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.607599:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef9327244d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.607695:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790946543.607753:0:11315:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef9327244d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.607764:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef9327244d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946543.607813:0:5821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914688711180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+53:2364:x1877943286550272:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 339us (852us total) trans 0 rc 0/0 00000004:00200000:2.0:1790946543.607819:0:11315:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000100:00100000:3.0:1790946543.607824:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 53 00000004:00200000:2.0:1790946543.607825:0:11315:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790946543.607848:0:11315:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef9327244d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.607879:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef93272446 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cde7 expref: 53 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.607892:0:11315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef9327244d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cde7 expref: 52 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.607897:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9146836df700) 00010000:00010000:2.0:1790946543.607900:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790946543.607902:0:11315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914688aef000, rc 0) 00000100:00100000:2.0:1790946543.607925:0:11315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be075500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+52:10545:x1877943286550144:12345-192.168.203.13@tcp:101:bash.0 Request processed in 5662us (5981us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946543.607939:0:11315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 106 00000100:00100000:0.0:1790946543.613436:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946543.613597:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286550528 00000100:00100000:1.0:1790946543.613610:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286550528 00000100:00100000:1.0:1790946543.613749:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 29 00000100:00100000:1.0:1790946543.613761:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+52:10545:x1877943286550528:12345-192.168.203.13@tcp:35:bash.0 00000100:00100000:1.0:1790946543.614096:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+53:10545:x1877943286550528:12345-192.168.203.13@tcp:35:bash.0 Request processed in 335us (673us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1790946543.614105:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 29 00000100:00100000:0.0:1790946543.687481:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946543.687831:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286550656 00000100:00100000:2.0:1790946543.687854:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286550656 00000100:00100000:2.0:1790946543.687927:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 107 00000100:00100000:2.0:1790946543.687938:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+53:10551:x1877943286550656:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1790946543.687968:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946543.687997:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef93272454 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cdee expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.688323:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef9327245b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.688343:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef9327245b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.688356:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef9327245b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790946543.688399:0:5834:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1790946543.688403:0:5834:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790946543.688426:0:5834:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef9327245b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.688456:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef93272454 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cdee expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.688478:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef9327245b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cdee expref: 54 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.688509:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91469e29d100) 00010000:00010000:2.0:1790946543.688512:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790946543.688516:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914688aef200, rc 0) 00000100:00100000:2.0:1790946543.688588:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+54:10551:x1877943286550656:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 652us (1123us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946543.688596:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 107 00000100:00100000:0.0:1790946543.692689:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946543.693108:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286550784 00000100:00100000:3.0:1790946543.693122:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286550784 00000100:00100000:3.0:1790946543.693196:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 108 00000100:00100000:3.0:1790946543.693232:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+54:10551:x1877943286550784:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1790946543.693259:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946543.693287:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93272462 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cdf5 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.693368:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93272469 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.693386:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93272469 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.693397:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93272469 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.693414:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef93272470 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.693439:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef93272470 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.693446:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef93272470 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.693555:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef93272477 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.693564:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef93272477 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.693571:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef93272477 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790946543.693613:0:5835:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1790946543.693618:0:5835:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790946543.693639:0:5835:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef93272477 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.693651:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef93272477 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.693661:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93272469 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.693668:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93272469 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.693675:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93272469 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.693691:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146a032b400 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946543.693697:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93272469 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.693706:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93272469 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.693720:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91469e29d100) 00010000:00010000:3.0:1790946543.693734:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946543.693740:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93272469 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.693746:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93272469 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.693761:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef93272470 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.693767:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef93272470 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.693774:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef93272470 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.693779:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146a032a800 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946543.693782:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef93272470 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.693789:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef93272470 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.693807:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9146836dfe00) 00010000:00010000:3.0:1790946543.693810:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946543.693813:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef93272470 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.693819:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef93272470 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.693853:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93272462 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cdf5 expref: 56 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.693868:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef93272477 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cdf5 expref: 55 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.693876:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9146836df700) 00010000:00010000:3.0:1790946543.693878:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790946543.693881:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146a032a400, rc 0) 00000100:00100000:3.0:1790946543.693957:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+55:10551:x1877943286550784:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 729us (1282us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946543.693965:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 108 00000100:00100000:0.0:1790946543.698113:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946543.698163:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946543.698298:0:5820:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286551168 00000100:00100000:1.0:1790946543.698311:0:5820:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286551168 00000100:00100000:2.0:1790946543.698373:0:11315:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286551040 00000100:00100000:2.0:1790946543.698378:0:11315:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286551040 00000100:00100000:1.0:1790946543.698385:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:1.0:1790946543.698394:0:5820:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146875b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+56:2362:x1877943286551168:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790946543.698414:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790946543.698426:0:11315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 109 00000100:00100000:2.0:1790946543.698433:0:11315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146875b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+56:10551:x1877943286551040:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1790946543.698444:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef93272477 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cdf5 expref: 56 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.698452:0:11315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946543.698465:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9146836df700) 00010000:00010000:2.0:1790946543.698469:0:11315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef9327247e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cdfc expref: -99 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946543.698485:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790946543.698550:0:5820:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146875b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+56:2362:x1877943286551168:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 157us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946543.698558:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 7 00010000:00010000:2.0:1790946543.698582:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93272485 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.698596:0:11315:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef9327244d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cde7 expref: 55 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.698605:0:11315:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93272485 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.698642:0:11315:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef9327244d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cde7 expref: 55 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.698657:0:11315:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef9327244d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cde7 expref: 55 pid: 11315 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946543.698680:0:11315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be849500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11315:1877943303344384:192.168.203.13@tcp:104: 00000100:00100000:2.0:1790946543.699132:0:11315:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146879a9300 going to sleep for 11 seconds 00000100:00100000:2.0:1790946543.702701:0:11315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be849500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11315:1877943303344384:192.168.203.13@tcp:104: 00010000:00010000:2.0:1790946543.702753:0:11315:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93272485 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946543.705779:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946543.706639:0:5821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286551296 00000100:00100000:3.0:1790946543.706654:0:5821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286551296 00010000:00010000:3.0:1790946543.706768:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef9327244d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cde7 expref: 56 pid: 11315 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946543.706868:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 54 00000100:00100000:3.0:1790946543.706880:0:5821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914685712050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+56:2363:x1877943286551296:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790946543.706920:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790946543.706929:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef9327244d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cde7 expref: 56 pid: 11315 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.706945:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef9327244d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cde7 expref: 56 pid: 11315 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.706971:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef9327244d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cde7 expref: 56 pid: 11315 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.706991:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9146836df700) 00010000:00010000:3.0:1790946543.706997:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93272485 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.707008:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93272485 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.707017:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93272485 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.707054:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790946543.707139:0:5821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914685712050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+55:2363:x1877943286551296:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 260us (1373us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946543.707147:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 54 00010000:00010000:2.0:1790946543.707309:0:11315:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93272485 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.707319:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93272485 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790946543.707344:0:11315:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1790946543.707542:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef9327247e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cdfc expref: 56 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.707560:0:11315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93272485 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cdfc expref: 55 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.707568:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9146836df700) 00010000:00010000:2.0:1790946543.707571:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790946543.707573:0:11315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914688aee600, rc 0) 00000100:00100000:2.0:1790946543.707604:0:11315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146875b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+55:10551:x1877943286551040:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 9172us (9505us total) trans 4294967397 rc 0/0 00000100:00100000:2.0:1790946543.707611:0:11315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 109 00000100:00100000:0.0:1790946543.710927:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946543.711008:0:5819:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286551552 00000100:00100000:3.0:1790946543.711021:0:5819:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286551552 00000100:00100000:3.0:1790946543.711098:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:3.0:1790946543.711110:0:5819:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146875b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+55:10551:x1877943286551552:12345-192.168.203.13@tcp:103:lfs.0 00010000:00010000:3.0:1790946543.711154:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790946543.711187:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032be00/0x16e41aef932723e4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cdd2 expref: 55 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.711239:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9146836df700) 00010000:00010000:3.0:1790946543.711245:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790946543.711322:0:5819:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146875b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+54:10551:x1877943286551552:12345-192.168.203.13@tcp:103:lfs.0 Request processed in 214us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946543.711331:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:0.0:1790946543.713958:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946543.714240:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286551680 00000100:00100000:2.0:1790946543.714272:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286551680 00000100:00100000:2.0:1790946543.714345:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 110 00000100:00100000:2.0:1790946543.714356:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146875b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+54:10551:x1877943286551680:12345-192.168.203.13@tcp:58:lfs.0 00010000:00010000:2.0:1790946543.714518:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef93272493 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.714539:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef93272493 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946543.714554:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef93272493 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790946543.715030:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1790946543.715136:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146875b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+54:10551:x1877943286551680:12345-192.168.203.13@tcp:58:lfs.0 Request processed in 780us (1189us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946543.715147:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 110 00000100:00100000:0.0:1790946543.717902:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946543.717993:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286551808 00000100:00100000:3.0:1790946543.718006:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286551808 00000100:00100000:3.0:1790946543.718067:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 111 00000100:00100000:3.0:1790946543.718077:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146875b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+54:10551:x1877943286551808:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1790946543.718107:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946543.718132:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032be00/0x16e41aef9327249a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0ce03 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.718243:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef93272493 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.718256:0:5835:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032be00/0x16e41aef9327249a lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce03 expref: 55 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.718281:0:5835:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef93272493 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.718298:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032be00/0x16e41aef9327249a lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce03 expref: 55 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.718336:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9146836df700) 00010000:00010000:3.0:1790946543.718340:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790946543.718345:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032be00/0x16e41aef9327249a lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce03 expref: 55 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946543.718353:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146a032be00, rc 0) 00000100:00100000:3.0:1790946543.718429:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146875b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+55:10551:x1877943286551808:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 353us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946543.718436:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 111 00010000:00010000:0.0:1790946543.920586:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790946544.048874:0:11687:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790946544.048887:0:11687:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790946544.048962:0:11687:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1790946544.048975:0:11687:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790946544.049131:0:11687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be849500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11687:1877943303344512:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790946544.050610:0:11687:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146879a9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790946544.056325:0:11687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be849500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11687:1877943303344512:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790946544.057594:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946544.058091:0:11315:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286551936 00000100:00100000:2.0:1790946544.058104:0:11315:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286551936 00000100:00100000:2.0:1790946544.058276:0:11315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 112 00000100:00100000:2.0:1790946544.058290:0:11315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914688710a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+55:10553:x1877943286551936:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000100:00080000:3.0:1790946544.058326:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000080:2.0:1790946544.058333:0:11315:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790946544.058501:0:11315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914688710a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+55:10553:x1877943286551936:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 214us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946544.058510:0:11315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 112 00000100:00100000:0.0:1790946544.067535:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946544.067691:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286552064 00000100:00100000:1.0:1790946544.067704:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286552064 00000100:00100000:1.0:1790946544.067836:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 113 00000100:00100000:1.0:1790946544.067848:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bdcca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+55:10553:x1877943286552064:12345-192.168.203.13@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1790946544.067950:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef932724a1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946544.067972:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef932724a1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946544.067989:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef932724a1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.074762:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef932724a8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.074787:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef932724a8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.074801:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef932724a8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.074947:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933400/0x16e41aef932724af lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.074959:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933400/0x16e41aef932724af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.074966:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933400/0x16e41aef932724af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790946544.075022:0:5836:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1790946544.075027:0:5836:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790946544.075041:0:5836:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933400/0x16e41aef932724af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.075053:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef932724a1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.075059:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef932724a1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.075066:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef932724a1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.075083:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180f800 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:0.0:1790946544.075087:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef932724a1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.075094:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef932724a1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.075105:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9146a0a5e900) 00010000:00010000:0.0:1790946544.075115:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790946544.075121:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef932724a1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.075128:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef932724a1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.075146:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef932724a8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.075151:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef932724a8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.075157:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef932724a8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.075162:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1933a00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:0.0:1790946544.075165:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef932724a8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.075171:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef932724a8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.075178:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff914686750900) 00010000:00010000:0.0:1790946544.075181:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790946544.075184:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef932724a8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.075190:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef932724a8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.075260:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933400/0x16e41aef932724af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.075274:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933400/0x16e41aef932724af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.075280:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933400/0x16e41aef932724af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.075287:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1933400 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:0.0:1790946544.075291:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933400/0x16e41aef932724af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.075299:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933400/0x16e41aef932724af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.075308:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9146836df700) 00010000:00010000:0.0:1790946544.075311:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790946544.075314:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933400/0x16e41aef932724af lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.075319:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933400/0x16e41aef932724af lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946544.075403:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bdcca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+55:10553:x1877943286552064:12345-192.168.203.13@tcp:34:lhsmtool_posix.0 Request processed in 7555us (7878us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946544.075413:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 113 00000100:00100000:0.0:1790946544.079347:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946544.079668:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286552320 00000100:00100000:2.0:1790946544.079683:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286552320 00000100:00100000:2.0:1790946544.079774:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 114 00000100:00100000:2.0:1790946544.079786:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bdcc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+55:10553:x1877943286552320:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790946544.079813:0:6803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946544.079839:0:6803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefa00/0x16e41aef932724b6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0ce0a expref: -99 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.079962:0:6803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef932724bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.079980:0:6803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef932724bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.079993:0:6803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef932724bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790946544.080007:0:6803:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1790946544.080141:0:6803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef932724bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.080150:0:6803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef932724bd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.080158:0:6803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef932724bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.080164:0:6803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aee400 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:2.0:1790946544.080185:0:6803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef932724bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.080194:0:6803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef932724bd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.080235:0:6803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9146836df700) 00010000:00010000:2.0:1790946544.080239:0:6803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790946544.080245:0:6803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef932724bd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.080251:0:6803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef932724bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.080301:0:6803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefa00/0x16e41aef932724b6 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce0a expref: 57 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.080313:0:6803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9146a0a5e900) 00010000:00010000:2.0:1790946544.080315:0:6803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790946544.080319:0:6803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefa00/0x16e41aef932724b6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce0a expref: 57 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.080330:0:6803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914688aefa00, rc 0) 00000100:00100000:2.0:1790946544.080431:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bdcc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+56:10553:x1877943286552320:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 646us (1098us total) trans 4294967398 rc 301/301 00000100:00100000:2.0:1790946544.080440:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 114 00000100:00100000:1.0:1790946544.083735:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946544.085625:0:11315:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286552448 00000100:00100000:2.0:1790946544.085647:0:11315:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286552448 00000100:00100000:2.0:1790946544.085744:0:11315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 115 00000100:00100000:2.0:1790946544.085757:0:11315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914688711180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+56:10553:x1877943286552448:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790946544.085830:0:11315:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790946544.085975:0:11315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914688711180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+56:10553:x1877943286552448:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 220us (2272us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946544.085984:0:11315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 115 00000100:00100000:1.0:1790946544.094626:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946544.096057:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286552704 00000100:00100000:0.0:1790946544.096077:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286552704 00000100:00100000:0.0:1790946544.096170:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 116 00000100:00100000:0.0:1790946544.096183:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914688712680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+56:10553:x1877943286552704:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790946544.096282:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946544.096286:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1790946544.096322:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef9327245b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cdee expref: 56 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.096347:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91469e29d100) 00010000:00010000:0.0:1790946544.096353:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790946544.096372:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef932724cb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0ce11 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790946544.097245:0:5836:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:0.0:1790946544.097851:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef932724d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.097872:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef932724d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.097886:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef932724d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.097964:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef932724cb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce11 expref: 58 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.097987:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef932724d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce11 expref: 57 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.097996:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff914686750900) 00010000:00010000:0.0:1790946544.097999:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790946544.098010:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b1933800, rc 0) 00000100:00100000:0.0:1790946544.098359:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914688712680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+57:10553:x1877943286552704:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 2177us (3745us total) trans 4294967399 rc 0/0 00000100:00100000:0.0:1790946544.098369:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 116 00000100:00100000:0.0:1790946544.107680:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946544.107963:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286552960 00000100:00100000:2.0:1790946544.107976:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286552960 00000100:00100000:2.0:1790946544.108090:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 117 00000100:00100000:2.0:1790946544.108103:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be978a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+57:10553:x1877943286552960:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790946544.108181:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790946544.108248:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef932724d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce11 expref: 57 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.108284:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff914686750900) 00010000:00010000:2.0:1790946544.108300:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790946544.108331:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefa00/0x16e41aef932724e0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.108349:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefa00/0x16e41aef932724e0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.108360:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefa00/0x16e41aef932724e0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.115970:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef932724e7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x68b671b6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.115994:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef932724e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x68b671b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.116026:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef932724e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x68b671b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.116097:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefa00/0x16e41aef932724e0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.116104:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefa00/0x16e41aef932724e0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.116110:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefa00/0x16e41aef932724e0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.116116:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aefa00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:2.0:1790946544.116120:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefa00/0x16e41aef932724e0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.116129:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefa00/0x16e41aef932724e0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.116140:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91469e29d100) 00010000:00010000:2.0:1790946544.116142:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790946544.116146:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefa00/0x16e41aef932724e0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.116152:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefa00/0x16e41aef932724e0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.116164:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef932724e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x68b671b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.116171:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef932724e7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x68b671b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.116183:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef932724e7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x68b671b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.116189:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aee400 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:2.0:1790946544.116192:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef932724e7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x68b671b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.116198:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef932724e7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x68b671b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.116232:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x68b671b6 (ffff9146a0a5e000) 00010000:00010000:2.0:1790946544.116235:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790946544.116238:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef932724e7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x68b671b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.116244:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef932724e7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x68b671b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946544.116576:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be978a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+56:10553:x1877943286552960:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 8471us (8905us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790946544.116587:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 117 00000004:00080000:0.0:1790946544.117174:0:7990:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 329188972229ns, next at 330188969664ns, rc = 0 00000100:00100000:0.0:1790946544.117239:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790946544.117253:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303344640:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790946544.117310:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946544.117376:0:6676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303344640 00000100:00100000:0.0:1790946544.117383:0:6676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303344640 00000100:00100000:0.0:1790946544.117420:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790946544.117428:0:6676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be97aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303344640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790946544.117592:0:6676:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790946544.117635:0:6676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be97aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303344640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 208us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946544.117641:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790946544.117680:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303344640:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790946544.119709:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946544.120138:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286553088 00000100:00100000:3.0:1790946544.120151:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286553088 00000100:00100000:3.0:1790946544.120357:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 118 00000100:00100000:3.0:1790946544.120368:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914688713480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+56:10553:x1877943286553088:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790946544.120635:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946544.120669:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef932724ee lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0ce18 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946544.120786:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef932724f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946544.120805:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef932724f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946544.120819:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef932724f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946544.120969:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef932724ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce18 expref: 58 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946544.120990:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef932724f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce18 expref: 57 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946544.120999:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9146836dfe00) 00010000:00010000:3.0:1790946544.121002:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790946544.121005:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146a032a800, rc 0) 00000100:00100000:3.0:1790946544.121147:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914688713480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+57:10553:x1877943286553088:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 780us (1449us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946544.121155:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 118 00000100:00100000:1.0:1790946544.133409:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946544.133503:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286553344 00000100:00100000:0.0:1790946544.133516:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286553344 00000100:00100000:0.0:1790946544.133591:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 119 00000100:00100000:0.0:1790946544.133603:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914688710700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+57:10553:x1877943286553344:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790946544.133760:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef932724fc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.133784:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef932724fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.133813:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef932724fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790946544.134130:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00010000:0.0:1790946544.134278:0:5836:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000cd1af30a reply state 000000001315bebd transno 4294967400 ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef932724fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946544.134290:0:5836:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790946544.134413:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914688710700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+59:10553:x1877943286553344:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 810us (1033us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1790946544.134421:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 119 00010000:00010000:0.0:1790946544.136401:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef932724fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.136419:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef932724fc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.136427:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef932724fc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.136433:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1933a00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:0.0:1790946544.136439:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef932724fc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.136448:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef932724fc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.136467:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9146836dfe00) 00010000:00010000:0.0:1790946544.136471:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790946544.136476:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef932724fc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.136499:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef932724fc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946544.138113:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946544.138399:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286553472 00000100:00100000:2.0:1790946544.138415:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286553472 00000100:00100000:2.0:1790946544.138496:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 120 00000100:00100000:2.0:1790946544.138505:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+58:10553:x1877943286553472:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790946544.138531:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946544.138553:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef93272503 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0ce1f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.138640:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef93272503 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce1f expref: 59 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.138655:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef93272503 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce1f expref: 59 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.138675:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9146836dfe00) 00010000:00010000:2.0:1790946544.138678:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790946544.138681:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914688aee400, rc 0) 00000100:00100000:2.0:1790946544.138760:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+59:10553:x1877943286553472:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 256us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946544.138767:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 120 00000100:00100000:1.0:1790946544.142510:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946544.142641:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286553600 00000100:00100000:2.0:1790946544.142656:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286553600 00000100:00100000:2.0:1790946544.142767:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 38 00000100:00100000:2.0:1790946544.142779:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+8:2364:x1877943286553600:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1790946544.143253:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+9:2364:x1877943286553600:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 Request processed in 474us (757us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1790946544.143263:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 38 00000100:00080000:3.0:1790946544.144014:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790946544.149027:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946544.149140:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286553856 00000100:00100000:2.0:1790946544.149152:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286553856 00000100:00100000:2.0:1790946544.149260:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 30 00000100:00100000:2.0:1790946544.149272:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5eb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+59:10553:x1877943286553856:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790946544.149772:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5eb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+60:10553:x1877943286553856:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 500us (755us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1790946544.149798:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 30 00000100:00100000:1.0:1790946544.152879:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946544.153115:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286554112 00000100:00100000:2.0:1790946544.153127:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286554112 00000100:00100000:2.0:1790946544.153237:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 121 00000100:00100000:2.0:1790946544.153250:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be0c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+60:10553:x1877943286554112:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1790946544.153557:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be0c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+60:10553:x1877943286554112:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 309us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946544.153566:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 121 00000100:00100000:3.0:1790946544.156269:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946544.156683:0:11315:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286554240 00000100:00100000:2.0:1790946544.156697:0:11315:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286554240 00000100:00100000:2.0:1790946544.156779:0:11315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 122 00000100:00100000:2.0:1790946544.156790:0:11315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914685636d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+60:10553:x1877943286554240:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790946544.156817:0:11315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946544.156852:0:11315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefa00/0x16e41aef9327250a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0ce26 expref: -99 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.156978:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef93272511 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.156998:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef93272511 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.157011:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef93272511 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790946544.157059:0:11315:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790946544.157084:0:11315:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef93272511 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.157128:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefa00/0x16e41aef9327250a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce26 expref: 62 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.157151:0:11315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef93272511 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce26 expref: 61 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.157161:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9146836dfe00) 00010000:00010000:2.0:1790946544.157165:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1790946544.157170:0:11315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914688aeec00, rc 0) 00000100:00100000:2.0:1790946544.157301:0:11315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914685636d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+61:10553:x1877943286554240:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 511us (1097us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946544.157310:0:11315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 122 00000100:00100000:1.0:1790946544.167384:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946544.167665:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286554368 00000100:00100000:3.0:1790946544.167678:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286554368 00000100:00100000:3.0:1790946544.167758:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 39 00000100:00100000:3.0:1790946544.167768:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be0c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+9:2364:x1877943286554368:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790946544.167791:0:6675:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946544.167822:0:6675:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c0d581b/0x16e41aef93272518 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0ce2d expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790946544.167856:0:6675:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abfacef, blocks: 0x1 00010000:00010000:3.0:1790946544.167880:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=329s v=(0 0) 00010000:00010000:3.0:1790946544.167886:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790946544.167897:0:6675:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c0d581b/0x16e41aef93272518 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce2d expref: 10 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946544.167945:0:6675:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008c0d581b/0x16e41aef93272518 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce2d expref: 10 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946544.167961:0:6675:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146a032bc00, rc 0) 00000100:00100000:3.0:1790946544.168040:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be0c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+10:2364:x1877943286554368:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 274us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946544.168049:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 39 00000100:00100000:0.0:1790946544.175419:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946544.175628:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286554624 00000100:00100000:2.0:1790946544.175643:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286554624 00000100:00100000:2.0:1790946544.175714:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 123 00000100:00100000:2.0:1790946544.175740:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+61:10553:x1877943286554624:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1790946544.175927:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+61:10553:x1877943286554624:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 188us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946544.175945:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 123 00000100:00100000:3.0:1790946544.182098:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946544.183097:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286554752 00000100:00100000:2.0:1790946544.183113:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286554752 00000100:00100000:3.0:1790946544.183596:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 40 00000100:00100000:3.0:1790946544.183610:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146befb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+10:10553:x1877943286554752:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790946544.183636:0:6674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946544.183661:0:6674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037f831dd/0x16e41aef9327251f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0ce34 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946544.183705:0:6674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008c0d581b/0x16e41aef93272518 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce2d expref: 11 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946544.183716:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790946544.183732:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790946544.183739:0:6674:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037f831dd/0x16e41aef9327251f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce34 expref: 11 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946544.183789:0:6674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008c0d581b/0x16e41aef93272518 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce2d expref: 11 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946544.183843:0:6674:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008c0d581b/0x16e41aef93272518 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce2d expref: 11 pid: 6675 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946544.183861:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91469829ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6674:1877943303344768:192.168.203.13@tcp:104: 00000100:00100000:3.0:1790946544.184058:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146b6328cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790946544.188980:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946544.191003:0:5821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286554880 00000100:00100000:0.0:1790946544.191032:0:5821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286554880 00010000:00010000:0.0:1790946544.191131:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008c0d581b/0x16e41aef93272518 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce2d expref: 12 pid: 6675 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946544.191295:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 55 00000100:00100000:0.0:1790946544.191307:0:5821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91469829f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+12:2364:x1877943286554880:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790946544.191364:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790946544.191434:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008c0d581b/0x16e41aef93272518 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce2d expref: 12 pid: 6675 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.191496:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008c0d581b/0x16e41aef93272518 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce2d expref: 12 pid: 6675 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.191544:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946544.191579:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946544.191604:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000037f831dd/0x16e41aef9327251f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce34 expref: 12 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.191617:0:5821:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037f831dd/0x16e41aef9327251f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce34 expref: 12 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.191787:0:5821:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000037f831dd/0x16e41aef9327251f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce34 expref: 12 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946544.191818:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be979c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5821:1877943303344896:192.168.203.13@tcp:105: 00000100:00100000:0.0:1790946544.192001:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146c1c9f840 going to sleep for 11 seconds 00010000:00010000:1.0:1790946544.193254:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c0d581b/0x16e41aef93272518 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce2d expref: 12 pid: 6675 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946544.193297:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91469829ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6674:1877943303344768:192.168.203.13@tcp:104: 00010000:00010000:1.0:1790946544.193332:0:6674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000037f831dd/0x16e41aef9327251f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce34 expref: 11 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946544.193349:0:6674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146a032b400, rc 0) 00000100:00100000:1.0:1790946544.193430:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146befb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+11:10553:x1877943286554752:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 9822us (11347us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946544.193440:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 40 00000100:00100000:0.0:1790946544.196621:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be979c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5821:1877943303344896:192.168.203.13@tcp:105: 00010000:00010000:0.0:1790946544.196674:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790946544.196848:0:5821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91469829f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+10:2364:x1877943286554880:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 5542us (7883us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946544.196861:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 55 00000100:00100000:0.0:1790946544.198476:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946544.198605:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286555008 00000100:00100000:3.0:1790946544.198616:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286555008 00002000:00100000:3.0:1790946544.198677:0:6680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9146be979c00 x1877943286555008/t0(0) o4->7eed1f4b-bd5b-4a70-8045-59db065b3dfc@192.168.203.13@tcp:485/0 lens 504/0 e 0 to 0 dl 1790946555 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790946544.198690:0:6680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9146be979c00 with x1877943286555008 ext(0->12) 00002000:00010000:3.0:1790946544.198697:0:6680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9146be979c00 00000100:00100000:3.0:1790946544.198749:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 3 00000100:00100000:3.0:1790946544.198759:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be979c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+10:2364:x1877943286555008:12345-192.168.203.13@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1790946544.199374:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be979c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+12:2364:x1877943286555008:12345-192.168.203.13@tcp:4:lhsmtool_posix.0 Request processed in 614us (908us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1790946544.199393:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 3 00002000:00100000:3.0:1790946544.199402:0:6680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9146be979c00 x1877943286555008/t4294967309(0) o4->7eed1f4b-bd5b-4a70-8045-59db065b3dfc@192.168.203.13@tcp:485/0 lens 504/448 e 0 to 0 dl 1790946555 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790946544.199411:0:6680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9146be979c00 with x1877943286555008 ext(0->12) 00002000:00010000:3.0:1790946544.199415:0:6680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9146be979c00 00000100:00100000:3.0:1790946544.202331:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946544.202487:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286555136 00000100:00100000:0.0:1790946544.202500:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286555136 00000100:00100000:0.0:1790946544.202578:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 124 00000100:00100000:0.0:1790946544.202590:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91469829ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+61:10553:x1877943286555136:12345-192.168.203.13@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1790946544.274961:0:5857:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:2.0:1790946544.274985:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:2.0:1790946544.275014:0:5857:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff914698bef480 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1790946544.275021:0:5857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff914685666e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff914698befcc0 00000020:00080000:2.0:1790946544.275025:0:5857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff914685666600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9146be856000 00000004:00080000:2.0:1790946544.275060:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:1.0:1790946544.275064:0:5868:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:2.0:1790946544.275069:0:5857:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9146879c7a80 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1790946544.275072:0:5857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff914682f29500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9146879c70c0 00000020:00080000:2.0:1790946544.275074:0:5857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff914682f29c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91468341e800 00000004:00080000:2.0:1790946544.275092:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:1.0:1790946544.275103:0:5868:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000001:00080000:2.0:1790946544.275115:0:5857:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967401 is committed 00000100:00100000:3.0:1790946544.275518:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790946544.275543:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146beef0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303345024:0@lo:6:osp-syn-1-0.0 00000020:00080000:1.0:1790946544.275592:0:5868:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1790946544.275631:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946544.275770:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303345024 00000100:00100000:1.0:1790946544.275780:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303345024 00000100:00100000:1.0:1790946544.275844:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1790946544.275854:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beef3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1877943303345024:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1790946544.275888:0:6675:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:1.0:1790946544.275920:0:6675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001841d622/0x16e41aef93272526 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946544.275959:0:6675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004357f1f7/0x16e41aef932722e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd93 expref: 11 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946544.275969:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1790946544.275974:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790946544.275990:0:6675:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001841d622/0x16e41aef93272526 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946544.276020:0:6675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004357f1f7/0x16e41aef932722e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd93 expref: 11 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946544.276037:0:6675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004357f1f7/0x16e41aef932722e8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd93 expref: 11 pid: 6674 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946544.276051:0:6675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be0c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6675:1877943303345152:192.168.203.13@tcp:104: 00000100:00100000:0.0:1790946544.276257:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91469829ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+15:10553:x1877943286555136:12345-192.168.203.13@tcp:44:lhsmtool_posix.0 Request processed in 73668us (73940us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946544.276268:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 124 00000100:00100000:1.0:1790946544.278163:0:6675:0:(client.c:2716:ptlrpc_set_wait()) set ffff914684f73cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790946544.278509:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946544.278634:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286555264 00000100:00100000:3.0:1790946544.278646:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286555264 00000100:00100000:3.0:1790946544.278707:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 42 00000100:00100000:3.0:1790946544.278733:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be849500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+12:2363:x1877943286555264:12345-192.168.203.13@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1790946544.279244:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be97b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303345280:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1790946544.279420:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946544.279539:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946544.279576:0:6675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be0c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6675:1877943303345152:192.168.203.13@tcp:104: 00010000:00010000:0.0:1790946544.279606:0:6675:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001841d622/0x16e41aef93272526 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946544.279822:0:6808:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1790946544.279832:0:6808:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1790946544.281516:0:6808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303345280 00000100:00100000:1.0:1790946544.281531:0:6808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303345280 00000100:00100000:2.0:1790946544.281735:0:12075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790946544.281747:0:12075:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beef2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3303:x1877943303345280:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1790946544.281789:0:12075:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:2.0:1790946544.281835:0:12075:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6abfacee, atime: 0x6abfacee, ctime: 0x6abfacee, blocks: 0x1 00010000:00010000:2.0:1790946544.281845:0:12075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da4c273b/0x16e41aef9327252d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.281868:0:12075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=329s v=(0 0) 00010000:00010000:2.0:1790946544.281873:0:12075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790946544.281882:0:12075:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da4c273b/0x16e41aef9327252d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.281901:0:12075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da4c273b/0x16e41aef9327252d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.281912:0:12075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da4c273b/0x16e41aef9327252d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.281933:0:12075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da4c273b/0x16e41aef9327252d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.282692:0:12075:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790946544.282747:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946544.282755:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da4c273b/0x16e41aef9327252d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.282768:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aef000 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:2.0:1790946544.282774:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da4c273b/0x16e41aef9327252d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.282786:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da4c273b/0x16e41aef9327252d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.282807:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da4c273b/0x16e41aef9327252d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.282814:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da4c273b/0x16e41aef9327252d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.282836:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946544.282838:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946544.282840:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946544.283929:0:5820:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286555392 00000100:00100000:3.0:1790946544.283957:0:5820:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286555392 00010000:00010000:3.0:1790946544.284016:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004357f1f7/0x16e41aef932722e8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd93 expref: 13 pid: 6674 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946544.284280:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 56 00000100:00100000:1.0:1790946544.284299:0:5819:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beef2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+13:2363:x1877943286555392:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790946544.284321:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790946544.284330:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004357f1f7/0x16e41aef932722e8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd93 expref: 13 pid: 6674 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946544.284337:0:12075:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beef2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3303:x1877943303345280:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2588us (4912us total) trans 4294967304 rc 0/0 00010000:00010000:1.0:1790946544.284349:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004357f1f7/0x16e41aef932722e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd93 expref: 13 pid: 6674 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946544.284359:0:12075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000004:00080000:3.0:1790946544.284585:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9146be97b100/2, rc 0, transno 4294967304 00000100:00100000:3.0:1790946544.284595:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be97b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303345280:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1790946544.284654:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004357f1f7/0x16e41aef932722e8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd93 expref: 13 pid: 6674 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946544.284677:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790946544.284691:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790946544.284699:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001841d622/0x16e41aef93272526 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946544.284710:0:5819:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001841d622/0x16e41aef93272526 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946544.284754:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790946544.284814:0:5819:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beef2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+12:2363:x1877943286555392:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 522us (5276us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946544.284824:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 56 00010000:00010000:0.0:1790946544.287275:0:6675:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001841d622/0x16e41aef93272526 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.287317:0:6675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001841d622/0x16e41aef93272526 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.287330:0:6675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001841d622/0x16e41aef93272526 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.287340:0:6675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001841d622/0x16e41aef93272526 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.287372:0:6675:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790946544.287874:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790946544.287886:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001841d622/0x16e41aef93272526 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946544.287898:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180ee00 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:1.0:1790946544.287903:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001841d622/0x16e41aef93272526 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946544.287915:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001841d622/0x16e41aef93272526 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946544.287943:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001841d622/0x16e41aef93272526 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946544.287951:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001841d622/0x16e41aef93272526 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946544.287992:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946544.288074:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946544.288077:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946544.289504:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beef3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3303:x1877943303345024:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13642us (13863us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1790946544.289520:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:1.0:1790946544.290660:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9146beef0a80/2, rc 0, transno 4294967310 00000100:00100000:1.0:1790946544.290691:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146beef0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303345024:0@lo:6:osp-syn-1-0.0 00000001:00080000:1.0:1790946544.336886:0:7645:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:1.0:1790946544.336909:0:7645:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:1.0:1790946544.336915:0:7645:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:0.0:1790946544.337066:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be849500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2363:x1877943286555264:12345-192.168.203.13@tcp:16:lhsmtool_posix.0 Request processed in 58340us (58551us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946544.337080:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 42 00000100:00100000:3.0:1790946544.339432:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946544.339616:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286555648 00000100:00100000:0.0:1790946544.339631:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286555648 00000100:00100000:0.0:1790946544.339708:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 125 00000100:00100000:0.0:1790946544.339730:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beef1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+15:10553:x1877943286555648:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790946544.339809:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790946544.339843:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef93272511 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce26 expref: 15 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.339869:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9146836dfe00) 00010000:00010000:0.0:1790946544.339892:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790946544.339935:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272534 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.339957:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272534 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.339969:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272534 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790946544.340328:0:5835:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000fc3f23eb reply state 00000000c36ff745 transno 4294967402 ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272534 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946544.340340:0:5835:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790946544.340472:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beef1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+16:10553:x1877943286555648:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 754us (1053us total) trans 4294967402 rc 0/0 00000100:00100000:0.0:1790946544.340481:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 125 00010000:00010000:0.0:1790946544.342437:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272534 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.342460:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272534 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.342469:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272534 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.342476:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1932400 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:0.0:1790946544.342481:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272534 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.342491:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272534 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.342533:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9146836dfe00) 00010000:00010000:0.0:1790946544.342536:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790946544.342543:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272534 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.342550:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272534 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946544.343047:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946544.343135:0:6808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286555776 00000100:00100000:1.0:1790946544.343147:0:6808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286555776 00000100:00100000:1.0:1790946544.343233:0:6808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 44 00000100:00100000:1.0:1790946544.343244:0:6808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beef0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2364:x1877943286555776:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1790946544.343635:0:6808:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1790946544.343640:0:6808:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1790946543 00002000:00010000:1.0:1790946544.343643:0:6808:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1790946542 00002000:00010000:1.0:1790946544.343645:0:6808:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1790946543 -> 1790946543 00002000:00010000:1.0:1790946544.343647:0:6808:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1790946544.343732:0:6808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beef0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+7:2364:x1877943286555776:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 Request processed in 489us (689us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1790946544.343742:0:6808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 44 00000100:00100000:2.0:1790946544.349195:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946544.349699:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286556032 00000100:00100000:0.0:1790946544.349712:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286556032 00000100:00100000:0.0:1790946544.349801:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 126 00000100:00100000:0.0:1790946544.349813:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be849f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+15:10553:x1877943286556032:12345-192.168.203.13@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1790946544.349919:0:6803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef9327253b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.350740:0:6803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef932724f5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce18 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.350759:0:6803:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef9327253b lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.350809:0:6803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef932724f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce18 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.350827:0:6803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef932724f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce18 expref: 15 pid: 5835 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946544.350845:0:6803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be978380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6803:1877943303345408:192.168.203.13@tcp:104: 00000100:00100000:0.0:1790946544.351072:0:6803:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146c1c9f000 going to sleep for 11 seconds 00000100:00100000:0.0:1790946544.354892:0:6803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be978380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6803:1877943303345408:192.168.203.13@tcp:104: 00010000:00010000:0.0:1790946544.355005:0:6803:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef9327253b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946544.356460:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946544.356623:0:5821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286556160 00000100:00100000:0.0:1790946544.356634:0:5821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286556160 00010000:00010000:0.0:1790946544.356683:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef932724f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce18 expref: 16 pid: 5835 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946544.356737:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 57 00000100:00100000:0.0:1790946544.356749:0:5821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be848a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+16:2363:x1877943286556160:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790946544.356768:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790946544.356775:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef932724f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce18 expref: 16 pid: 5835 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.356790:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef932724f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce18 expref: 16 pid: 5835 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.356819:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef932724f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce18 expref: 16 pid: 5835 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.356838:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9146836dfe00) 00010000:00010000:0.0:1790946544.356844:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef9327253b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.356860:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef9327253b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.356893:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef9327253b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.356973:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790946544.357051:0:5821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be848a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+15:2363:x1877943286556160:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 303us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946544.357059:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 57 00010000:00010000:2.0:1790946544.357158:0:6803:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef9327253b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.357166:0:6803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef9327253b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.357411:0:6803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef9327253b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.357421:0:6803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef9327253b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.357429:0:6803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef9327253b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.357437:0:6803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1933a00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:2.0:1790946544.357442:0:6803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef9327253b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.357450:0:6803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef9327253b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.357461:0:6803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9146836dfe00) 00010000:00010000:2.0:1790946544.357464:0:6803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1790946544.357468:0:6803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef9327253b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.357474:0:6803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef9327253b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946544.357548:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be849f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+14:10553:x1877943286556032:12345-192.168.203.13@tcp:55:lhsmtool_posix.0 Request processed in 7737us (8367us total) trans 0 rc -22/-22 00000100:00100000:2.0:1790946544.357557:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 126 00000100:00100000:2.0:1790946544.362662:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946544.363064:0:12075:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286556288 00000100:00100000:1.0:1790946544.363079:0:12075:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286556288 00000100:00100000:1.0:1790946544.363153:0:12075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 45 00000100:00100000:1.0:1790946544.363165:0:12075:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be84b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+7:2364:x1877943286556288:12345-192.168.203.13@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1790946544.363269:0:12075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001841d622/0x16e41aef93272542 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946544.363312:0:12075:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000037f831dd/0x16e41aef9327251f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce34 expref: 7 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946544.363322:0:12075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946544.363327:0:12075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790946544.363333:0:12075:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001841d622/0x16e41aef93272542 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946544.363566:0:12075:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000037f831dd/0x16e41aef9327251f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce34 expref: 7 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946544.363586:0:12075:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000037f831dd/0x16e41aef9327251f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce34 expref: 7 pid: 6674 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946544.363678:0:12075:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be0c7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12075:1877943303345536:192.168.203.13@tcp:104: 00000100:00100000:1.0:1790946544.364078:0:12075:0:(client.c:2716:ptlrpc_set_wait()) set ffff91469e292540 going to sleep for 11 seconds 00000100:00100000:1.0:1790946544.367426:0:12075:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be0c7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12075:1877943303345536:192.168.203.13@tcp:104: 00010000:00010000:1.0:1790946544.367468:0:12075:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001841d622/0x16e41aef93272542 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946544.374425:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946544.374567:0:5819:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286556416 00000100:00100000:1.0:1790946544.374582:0:5819:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286556416 00010000:00010000:1.0:1790946544.374638:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000037f831dd/0x16e41aef9327251f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce34 expref: 8 pid: 6674 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946544.374739:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 58 00000100:00100000:1.0:1790946544.374751:0:5819:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be84a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+8:2364:x1877943286556416:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790946544.374786:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790946544.374818:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000037f831dd/0x16e41aef9327251f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce34 expref: 8 pid: 6674 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946544.374834:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000037f831dd/0x16e41aef9327251f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce34 expref: 8 pid: 6674 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946544.374871:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037f831dd/0x16e41aef9327251f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce34 expref: 8 pid: 6674 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946544.374894:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790946544.374899:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790946544.374905:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001841d622/0x16e41aef93272542 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946544.374918:0:5819:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001841d622/0x16e41aef93272542 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946544.374958:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790946544.375026:0:5819:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be84a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+7:2364:x1877943286556416:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 277us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946544.375036:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 58 00010000:00010000:2.0:1790946544.375381:0:12075:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001841d622/0x16e41aef93272542 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.375395:0:12075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001841d622/0x16e41aef93272542 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.375430:0:12075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001841d622/0x16e41aef93272542 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.375439:0:12075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001841d622/0x16e41aef93272542 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.375448:0:12075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001841d622/0x16e41aef93272542 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.375456:0:12075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180ee00 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:2.0:1790946544.375461:0:12075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001841d622/0x16e41aef93272542 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.375472:0:12075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001841d622/0x16e41aef93272542 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.375495:0:12075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001841d622/0x16e41aef93272542 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.375503:0:12075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001841d622/0x16e41aef93272542 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946544.375568:0:12075:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be84b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2364:x1877943286556288:12345-192.168.203.13@tcp:1:lhsmtool_posix.0 Request processed in 12405us (12922us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946544.375578:0:12075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 45 00000100:00100000:2.0:1790946544.382899:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946544.383092:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286556672 00000100:00100000:0.0:1790946544.383106:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286556672 00000100:00100000:0.0:1790946544.383259:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 127 00000100:00100000:0.0:1790946544.383272:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be84ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+14:10553:x1877943286556672:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1790946544.383531:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272549 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.383553:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272549 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.383567:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272549 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.383861:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272550 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.383874:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef93272503 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce1f expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.383885:0:5836:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272550 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.383948:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef93272503 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce1f expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.383965:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef93272503 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce1f expref: 15 pid: 5834 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946544.383982:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be978380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5836:1877943303345664:192.168.203.13@tcp:104: 00000100:00100000:0.0:1790946544.384374:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146c1c9f000 going to sleep for 11 seconds 00000100:00100000:1.0:1790946544.389119:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946544.389286:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be978380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5836:1877943303345664:192.168.203.13@tcp:104: 00010000:00010000:0.0:1790946544.389328:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272550 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946544.389559:0:5821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286556800 00000100:00100000:3.0:1790946544.389569:0:5821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286556800 00010000:00010000:3.0:1790946544.389615:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef93272503 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce1f expref: 16 pid: 5834 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946544.389659:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 59 00000100:00100000:3.0:1790946544.389671:0:5821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be0c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+16:2364:x1877943286556800:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790946544.389713:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790946544.389730:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef93272503 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce1f expref: 16 pid: 5834 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946544.389745:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef93272503 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce1f expref: 16 pid: 5834 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946544.389934:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef93272503 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce1f expref: 16 pid: 5834 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946544.389954:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9146836dfe00) 00010000:00010000:3.0:1790946544.389959:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272550 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946544.389972:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272550 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946544.389981:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272550 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946544.390060:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790946544.390140:0:5821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be0c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+15:2364:x1877943286556800:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 470us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946544.390148:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 59 00010000:00010000:0.0:1790946544.393983:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272550 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946544.394007:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272550 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790946544.395058:0:5836:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:1.0:1790946544.395488:0:5836:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:1.0:1790946544.395542:0:5836:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:1.0:1790946544.395663:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be0c6680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5836:1877943303345792:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1790946544.395878:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946544.396027:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9145879aa000 going to sleep for 11 seconds 00000100:00100000:3.0:1790946544.396427:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303345792 00000100:00100000:3.0:1790946544.396438:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303345792 00000100:00100000:3.0:1790946544.396503:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790946544.396513:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be0c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5836:x1877943303345792:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1790946544.396661:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be0c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5836:x1877943303345792:12345-0@lo:1000:mdt00_002.0 Request processed in 149us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946544.396700:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790946544.396891:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be0c6680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5836:1877943303345792:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1790946544.397977:0:5836:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:1.0:1790946544.399285:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be0c6680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5836:1877943303345920:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1790946544.399476:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946544.399524:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9145879aacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790946544.399898:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303345920 00000100:00100000:0.0:1790946544.399913:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303345920 00000100:00100000:0.0:1790946544.399991:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790946544.400002:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468e93ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5836:x1877943303345920:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1790946544.400675:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468e93ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5836:x1877943303345920:12345-0@lo:1000:mdt00_002.0 Request processed in 672us (1197us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1790946544.400686:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790946544.401055:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be0c6680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5836:1877943303345920:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1790946544.401130:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272550 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946544.401142:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272550 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946544.401151:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272550 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946544.401158:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1933800 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:1.0:1790946544.401163:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272550 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946544.401171:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272550 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946544.401189:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9146836dfe00) 00010000:00010000:1.0:1790946544.401222:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790946544.401229:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272550 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946544.401237:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272550 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946544.401277:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef93272493 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946544.401284:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef93272493 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946544.401290:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef93272493 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946544.401295:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aee000 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:1.0:1790946544.401297:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef93272493 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946544.401303:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef93272493 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946544.401311:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9146836df700) 00010000:00010000:1.0:1790946544.401313:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790946544.401322:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032be00/0x16e41aef9327249a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce03 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946544.401347:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032be00/0x16e41aef9327249a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce03 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946544.401358:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032be00/0x16e41aef9327249a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce03 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946544.401406:0:5836:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032be00/0x16e41aef9327249a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce03 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946544.401423:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91468e93d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5836:1877943303346048:192.168.203.13@tcp:105: 00000100:00100000:1.0:1790946544.401517:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9145879aacc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790946544.405434:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91468e93d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5836:1877943303346048:192.168.203.13@tcp:105: 00010000:00010000:3.0:1790946544.405477:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef93272493 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946544.405491:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef93272493 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946544.405536:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a200/0x16e41aef93272557 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946544.405554:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a200/0x16e41aef93272557 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946544.405567:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a200/0x16e41aef93272557 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946544.405580:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a200/0x16e41aef93272557 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946544.405588:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a200/0x16e41aef93272557 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946544.405596:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a200/0x16e41aef93272557 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946544.405602:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146a032a200 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946544.405607:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a200/0x16e41aef93272557 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946544.405615:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a200/0x16e41aef93272557 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946544.405646:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9146836df700) 00010000:00010000:3.0:1790946544.405649:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946544.405653:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a200/0x16e41aef93272557 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946544.405660:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a200/0x16e41aef93272557 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946544.405669:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272549 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946544.405676:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272549 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946544.405682:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272549 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946544.405687:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1932400 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946544.405690:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272549 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946544.405696:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272549 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946544.405703:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9146836df700) 00010000:00010000:3.0:1790946544.405705:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790946544.405708:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272549 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946544.405712:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272549 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946544.406459:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be84ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+18:10553:x1877943286556672:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 23184us (23572us total) trans 4294967407 rc 0/0 00000100:00100000:3.0:1790946544.406473:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 127 00000040:00080000:2.0:1790946544.406481:0:11687:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000020:00080000:3.0:1790946544.406482:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1790946544.406487:0:11687:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790946544.407114:0:11687:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1790946544.407126:0:11687:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790946544.412071:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946544.412919:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286556928 00000100:00100000:3.0:1790946544.412938:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286556928 00000100:00100000:3.0:1790946544.413077:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 31 00000100:00100000:3.0:1790946544.413092:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468e93f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+18:10551:x1877943286556928:12345-192.168.203.13@tcp:49:lfs.0 00000100:00100000:3.0:1790946544.413312:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468e93f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+18:10551:x1877943286556928:12345-192.168.203.13@tcp:49:lfs.0 Request processed in 223us (1257us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946544.413321:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 31 00000100:00100000:1.0:1790946544.414296:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946544.414377:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286557184 00000100:00100000:3.0:1790946544.414389:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286557184 00000100:00100000:3.0:1790946544.414525:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 32 00000100:00100000:3.0:1790946544.414536:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b2652450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+18:10553:x1877943286557184:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1790946544.417033:0:5837:0:(mdd_object.c:4180:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1790946544.417152:0:5837:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967408 00010000:00010000:3.0:1790946544.417270:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef9327255e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946544.417296:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef9327255e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946544.417309:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef9327255e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946544.417321:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef9327255e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946544.417336:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef9327255e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946544.417343:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef9327255e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946544.417370:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790946544.417505:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946544.417515:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef9327255e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.417525:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146a032ae00 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:2.0:1790946544.417530:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef9327255e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.417540:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef9327255e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.417554:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9146836df900) 00010000:00010000:2.0:1790946544.417558:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1790946544.417571:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef9327255e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.417578:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef9327255e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.417600:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946544.417603:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946544.417605:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946544.417953:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b2652450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+20:10553:x1877943286557184:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 3413us (3662us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1790946544.417964:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 32 00000020:00080000:3.0:1790946544.417972:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1790946544.432592:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946544.432758:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286557440 00000100:00100000:3.0:1790946544.432773:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286557440 00000100:00100000:3.0:1790946544.432988:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 128 00000100:00100000:3.0:1790946544.433002:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be978380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+20:10551:x1877943286557440:12345-192.168.203.13@tcp:58:lfs.0 00000040:00080000:3.0:1790946544.433387:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1790946544.433506:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be978380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+20:10551:x1877943286557440:12345-192.168.203.13@tcp:58:lfs.0 Request processed in 506us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946544.433516:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 128 00000100:00100000:0.0:1790946544.455484:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946544.456249:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286557568 00000100:00100000:3.0:1790946544.456263:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286557568 00000100:00100000:3.0:1790946544.456340:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 129 00000100:00100000:3.0:1790946544.456353:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+20:10555:x1877943286557568:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1790946544.456388:0:6803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946544.456416:0:6803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a200/0x16e41aef93272565 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0ce3b expref: -99 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946544.456518:0:6803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef9327256c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946544.456538:0:6803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef9327256c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946544.456551:0:6803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef9327256c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946544.456567:0:6803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93272573 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946544.456574:0:6803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93272573 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946544.456581:0:6803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93272573 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946544.456868:0:6803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef9327257a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946544.456882:0:6803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93272485 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cdfc expref: 21 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946544.456891:0:6803:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef9327257a lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946544.456931:0:6803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93272485 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cdfc expref: 21 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946544.456960:0:6803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93272485 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cdfc expref: 21 pid: 11315 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946544.456976:0:6803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146beef2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6803:1877943303346176:192.168.203.13@tcp:104: 00000100:00100000:3.0:1790946544.457579:0:6803:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146b6328840 going to sleep for 11 seconds 00000100:00100000:3.0:1790946544.460267:0:6803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146beef2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6803:1877943303346176:192.168.203.13@tcp:104: 00010000:00010000:3.0:1790946544.460305:0:6803:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef9327257a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946544.461299:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946544.461402:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286557824 00000100:00100000:2.0:1790946544.461413:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286557824 00000100:00100000:2.0:1790946544.461481:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 33 00000100:00100000:2.0:1790946544.461493:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+22:5599:x1877943286557824:12345-192.168.203.13@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1790946544.461799:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+23:5599:x1877943286557824:12345-192.168.203.13@tcp:35:ldlm_bl.0 Request processed in 307us (506us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1790946544.461807:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 33 00000100:00100000:1.0:1790946544.465101:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946544.465253:0:5820:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286557952 00000100:00100000:3.0:1790946544.465267:0:5820:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286557952 00010000:00010000:3.0:1790946544.465321:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93272485 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cdfc expref: 23 pid: 11315 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946544.465377:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 60 00000100:00100000:3.0:1790946544.465388:0:5820:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914685713450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+23:2364:x1877943286557952:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790946544.465409:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790946544.465417:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93272485 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cdfc expref: 23 pid: 11315 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946544.465432:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93272485 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cdfc expref: 23 pid: 11315 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946544.465459:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93272485 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cdfc expref: 23 pid: 11315 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946544.465503:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9146836df700) 00010000:00010000:3.0:1790946544.465508:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef9327257a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946544.465520:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef9327257a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946544.465529:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef9327257a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946544.465568:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790946544.465647:0:5820:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914685713450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+22:2364:x1877943286557952:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 261us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946544.465656:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 60 00010000:00010000:2.0:1790946544.465848:0:6803:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef9327257a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.465858:0:6803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef9327257a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790946544.465916:0:6803:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1790946544.465922:0:6803:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790946544.465950:0:6803:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef9327257a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.465965:0:6803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef9327257a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.465977:0:6803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef9327256c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.465993:0:6803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef9327256c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.466001:0:6803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef9327256c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.466115:0:6803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146a032ae00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:2.0:1790946544.466125:0:6803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef9327256c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.466138:0:6803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef9327256c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.466149:0:6803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91469e29d100) 00010000:00010000:2.0:1790946544.466152:0:6803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790946544.466157:0:6803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef9327256c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.466163:0:6803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef9327256c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.466176:0:6803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93272573 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.466183:0:6803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93272573 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.466189:0:6803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93272573 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.466194:0:6803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146a032b400 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:2.0:1790946544.467137:0:6803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93272573 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.467148:0:6803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93272573 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.467160:0:6803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9146836df400) 00010000:00010000:2.0:1790946544.467164:0:6803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790946544.467167:0:6803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93272573 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.467174:0:6803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93272573 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.467255:0:6803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a200/0x16e41aef93272565 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce3b expref: 22 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.467273:0:6803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef9327257a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce3b expref: 21 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946544.467281:0:6803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9146836df700) 00010000:00010000:2.0:1790946544.467283:0:6803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790946544.467286:0:6803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146a032a800, rc 0) 00000100:00100000:2.0:1790946544.467360:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+21:10555:x1877943286557568:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 11008us (11889us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946544.467369:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 129 00010000:00010000:1.0:1790946544.948439:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790946545.270902:0:12113:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790946545.270915:0:12113:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790946545.270973:0:12113:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1790946545.270981:0:12113:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1790946545.456443:0:11687:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790946545.456457:0:11687:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790946545.456501:0:11687:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1790946545.456508:0:11687:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790946545.456665:0:11687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be848a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11687:1877943303346304:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790946545.456799:0:11687:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146879c7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790946545.460049:0:11687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be848a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11687:1877943303346304:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790946545.463895:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946545.464979:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286558080 00000100:00100000:3.0:1790946545.464995:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286558080 00000100:00100000:3.0:1790946545.465092:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 130 00000100:00100000:3.0:1790946545.465105:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468e93f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+21:10567:x1877943286558080:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790946545.465154:0:5836:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790946545.465315:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468e93f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+21:10567:x1877943286558080:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 213us (1431us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946545.465324:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 130 00000100:00100000:2.0:1790946545.478879:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946545.479806:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286558336 00000100:00100000:3.0:1790946545.479828:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286558336 00000100:00100000:3.0:1790946545.479914:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 131 00000100:00100000:3.0:1790946545.479927:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be848a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+21:10567:x1877943286558336:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790946545.479970:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946545.479998:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef93272581 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0ce42 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946545.480349:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93272588 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946545.480369:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93272588 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946545.480383:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93272588 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790946545.480399:0:5835:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1790946545.486517:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef93272581 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce42 expref: 24 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946545.486552:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93272588 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce42 expref: 23 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946545.486565:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9146836df700) 00010000:00010000:3.0:1790946545.486569:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790946545.486573:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146a032bc00, rc 0) 00000100:00100000:3.0:1790946545.487008:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be848a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+23:10567:x1877943286558336:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 7081us (8143us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1790946545.487019:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 131 00000100:00100000:2.0:1790946545.495098:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946545.495184:0:5819:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286558464 00000100:00100000:0.0:1790946545.495536:0:5819:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286558464 00000100:00100000:0.0:1790946545.495619:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:0.0:1790946545.495632:0:5819:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be84a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+23:2363:x1877943286558464:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790946545.495653:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790946545.495687:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93272588 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce42 expref: 23 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946545.496524:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9146836df700) 00010000:00010000:0.0:1790946545.496536:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790946545.496625:0:5819:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be84a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+22:2363:x1877943286558464:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 994us (1539us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946545.496636:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:2.0:1790946545.498554:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946545.498909:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286558720 00000100:00100000:2.0:1790946545.498923:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286558720 00000100:00100000:2.0:1790946545.499070:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 132 00000100:00100000:2.0:1790946545.499083:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be848380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+22:10567:x1877943286558720:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1790946545.499282:0:6803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef93272596 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946545.499305:0:6803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef93272596 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946545.499324:0:6803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef93272596 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946545.499585:0:6803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef93272596 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946545.499596:0:6803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef93272596 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946545.500107:0:6803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef93272596 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946545.500130:0:6803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aef000 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:2.0:1790946545.500137:0:6803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef93272596 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946545.500146:0:6803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef93272596 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946545.500262:0:6803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9146836df700) 00010000:00010000:2.0:1790946545.500266:0:6803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790946545.500272:0:6803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef93272596 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946545.500279:0:6803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef93272596 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946545.500502:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be848380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+23:10567:x1877943286558720:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 1418us (1957us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1790946545.500515:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 132 00000040:00080000:2.0:1790946545.501398:0:11687:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790946545.501406:0:11687:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790946545.502097:0:11687:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1790946545.502110:0:11687:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790946545.510881:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946545.511141:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286558976 00000100:00100000:3.0:1790946545.511154:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286558976 00000100:00100000:3.0:1790946545.511269:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 34 00000100:00100000:3.0:1790946545.511335:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be84b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+23:10567:x1877943286558976:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1790946545.511651:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be84b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+24:10567:x1877943286558976:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 320us (784us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1790946545.511660:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 34 00010000:00010000:2.0:1790946545.968419:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946546.163586:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be848e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303346432:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790946546.163691:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946546.163949:0:6676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303346432 00000100:00100000:1.0:1790946546.163962:0:6676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303346432 00000100:00100000:1.0:1790946546.164041:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790946546.164054:0:6676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3300:x1877943303346432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790946546.164116:0:6676:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790946546.164178:0:6676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3300:x1877943303346432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946546.164186:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790946546.164993:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be848e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303346432:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1790946546.165010:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790946546.993214:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790946547.177693:0:12164:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790946547.177715:0:12164:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790946547.177778:0:12164:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1790946547.177794:0:12164:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790946547.352582:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946547.352662:0:11315:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286559232 00000100:00100000:1.0:1790946547.352676:0:11315:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286559232 00000100:00100000:1.0:1790946547.352771:0:11315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 133 00000100:00100000:1.0:1790946547.352784:0:11315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beef2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+24:10587:x1877943286559232:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1790946547.352819:0:11315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946547.352847:0:11315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef9327259d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0ce49 expref: -99 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946547.353006:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef932725a4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946547.353023:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef932725a4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946547.353037:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef932725a4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790946547.353048:0:11315:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1790946547.353237:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef9327259d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce49 expref: 27 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946547.353258:0:11315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef932725a4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce49 expref: 26 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946547.353267:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9146836df700) 00010000:00010000:1.0:1790946547.353270:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1790946547.353274:0:11315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b180ee00, rc 0) 00000100:00100000:1.0:1790946547.353352:0:11315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beef2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+26:10587:x1877943286559232:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 571us (783us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1790946547.353360:0:11315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 133 00000100:00080000:3.0:1790946547.353565:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790946547.358386:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946547.358570:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286559360 00000100:00100000:0.0:1790946547.358586:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286559360 00000100:00100000:0.0:1790946547.358665:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 134 00000100:00100000:0.0:1790946547.358677:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be848e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+26:10587:x1877943286559360:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:0.0:1790946547.358792:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933400/0x16e41aef932725b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946547.358816:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933400/0x16e41aef932725b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946547.358830:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933400/0x16e41aef932725b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946547.358887:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933400/0x16e41aef932725b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946547.358895:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933400/0x16e41aef932725b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946547.358903:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933400/0x16e41aef932725b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946547.358910:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1933400 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:0.0:1790946547.358916:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933400/0x16e41aef932725b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946547.358925:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933400/0x16e41aef932725b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946547.358940:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9146836df700) 00010000:00010000:0.0:1790946547.358955:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790946547.358962:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933400/0x16e41aef932725b2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946547.358969:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933400/0x16e41aef932725b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946547.359072:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be848e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+26:10587:x1877943286559360:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 395us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946547.359081:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 134 00000100:00100000:1.0:1790946547.460834:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946547.462152:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286559488 00000100:00100000:0.0:1790946547.462170:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286559488 00000100:00100000:0.0:1790946547.462537:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 46 00000100:00100000:0.0:1790946547.462568:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468e93e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2364:x1877943286559488:12345-192.168.203.13@tcp:101:cat.0 00010000:00010000:0.0:1790946547.462594:0:6673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946547.462620:0:6673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000892c7a1b/0x16e41aef932725b9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0ce50 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790946547.462654:0:6673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6abfacef, atime: 0x6abfacee, ctime: 0x6abfacef, blocks: 0xb 00010000:00010000:0.0:1790946547.462682:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=332s v=(0 0) 00010000:00010000:0.0:1790946547.462688:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946547.462708:0:6673:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000892c7a1b/0x16e41aef932725b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce50 expref: 7 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946547.462731:0:6673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000892c7a1b/0x16e41aef932725b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce50 expref: 7 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946547.462747:0:6673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b1933400, rc 0) 00000100:00100000:0.0:1790946547.462836:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468e93e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+7:2364:x1877943286559488:12345-192.168.203.13@tcp:101:cat.0 Request processed in 271us (2017us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946547.462844:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 46 00000100:00080000:3.0:1790946547.465539:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790946547.471711:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946547.475317:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286559616 00000100:00100000:0.0:1790946547.475338:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286559616 00002000:00100000:0.0:1790946547.475427:0:6679:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9146be84a300 x1877943286559616/t0(0) o3->7eed1f4b-bd5b-4a70-8045-59db065b3dfc@192.168.203.13@tcp:488/0 lens 488/0 e 0 to 0 dl 1790946558 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790946547.475441:0:6679:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9146be84a300 with x1877943286559616 ext(0->4095) 00002000:00010000:0.0:1790946547.475448:0:6679:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9146be84a300 00000100:00100000:0.0:1790946547.475491:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:0.0:1790946547.475502:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be84a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+7:2361:x1877943286559616:12345-192.168.203.13@tcp:3:cat.0 00000100:00100000:0.0:1790946547.475831:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be84a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+7:2361:x1877943286559616:12345-192.168.203.13@tcp:3:cat.0 Request processed in 329us (4145us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1790946547.475840:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 4 00002000:00100000:0.0:1790946547.475848:0:6679:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9146be84a300 x1877943286559616/t0(0) o3->7eed1f4b-bd5b-4a70-8045-59db065b3dfc@192.168.203.13@tcp:488/0 lens 488/4536 e 0 to 0 dl 1790946558 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790946547.475856:0:6679:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9146be84a300 with x1877943286559616 ext(0->4095) 00002000:00010000:0.0:1790946547.475860:0:6679:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9146be84a300 00010000:00010000:2.0:1790946548.016704:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1790946548.293037:0:6700:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:2.0:1790946548.293059:0:6700:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:2.0:1790946548.293066:0:6700:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:3.0:1790946548.452241:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946548.452304:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286559744 00000100:00100000:0.0:1790946548.452318:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286559744 00000100:00100000:0.0:1790946548.452388:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 292 00000100:00100000:0.0:1790946548.452400:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:2363:x1877943286559744:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1790946548.452500:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:2363:x1877943286559744:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 101us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946548.452509:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 292 00000100:00100000:0.0:1790946548.452594:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946548.452762:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946548.452797:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946548.452824:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946548.452847:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286560256 00000100:00100000:0.0:1790946548.452851:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286560000 00000100:00100000:3.0:1790946548.452854:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286560256 00000100:00100000:0.0:1790946548.452857:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286560000 00000100:00100000:3.0:1790946548.452912:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286559872 00000100:00100000:0.0:1790946548.452915:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286560128 00000100:00100000:3.0:1790946548.452916:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286559872 00000100:00100000:0.0:1790946548.452921:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286560128 00000100:00100000:3.0:1790946548.452961:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 140 00000100:00100000:3.0:1790946548.452970:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+5:2363:x1877943286560256:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790946548.453019:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+5:2363:x1877943286560256:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 50us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946548.453027:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 140 00000100:00100000:3.0:1790946548.453043:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 141 00000100:00100000:3.0:1790946548.453050:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be124000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+26:2363:x1877943286559872:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790946548.453079:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be124000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+26:2363:x1877943286559872:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 29us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946548.453086:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 141 00000100:00080000:3.0:1790946548.453105:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790946548.453110:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790946548.453397:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 76 00000100:00100000:0.0:1790946548.453408:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+5:2363:x1877943286560000:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1790946548.453442:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+5:2363:x1877943286560000:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 37us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946548.453460:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 76 00000100:00100000:0.0:1790946548.453474:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 77 00000100:00100000:0.0:1790946548.453480:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be127480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+7:2363:x1877943286560128:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1790946548.453512:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be127480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+7:2363:x1877943286560128:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 32us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946548.453519:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 77 00000100:00100000:3.0:1790946548.721604:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146beef2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3301:1877943303346560:0@lo:400:kworker.0 00000100:00100000:3.0:1790946548.721731:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946548.721798:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146beef1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1877943303347072:0@lo:400:kworker.0 00000100:00100000:3.0:1790946548.721829:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946548.721858:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790946548.721865:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146beef2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303346944:0@lo:400:kworker.0 00000100:00100000:3.0:1790946548.721893:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946548.721921:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146beef3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877943303346688:0@lo:400:kworker.0 00000100:00100000:3.0:1790946548.721946:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946548.721964:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146beef0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303347200:0@lo:400:kworker.0 00000100:00100000:3.0:1790946548.721984:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946548.722002:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790946548.722008:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146beef1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1877943303346816:0@lo:400:kworker.0 00000100:00100000:3.0:1790946548.722031:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946548.722064:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303346560 00000100:00100000:3.0:1790946548.722074:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303346560 00000100:00100000:3.0:1790946548.722128:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1790946548.722137:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3301:x1877943303346560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946548.722218:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3301:x1877943303346560:12345-0@lo:400:kworker.0 Request processed in 62us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946548.722227:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1790946548.722264:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303347072 00000100:00100000:3.0:1790946548.722268:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303347072 00000100:00100000:3.0:1790946548.722302:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303346688 00000100:00100000:3.0:1790946548.722305:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303346688 00000100:00100000:3.0:1790946548.722320:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303346816 00000100:00100000:3.0:1790946548.722322:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303346816 00000100:00100000:3.0:1790946548.722337:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1790946548.722585:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1790946548.722596:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beef0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877943303346688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946548.722645:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beef0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877943303346688:12345-0@lo:400:kworker.0 Request processed in 52us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946548.722663:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1790946548.722699:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1790946548.722705:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beef1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877943303346816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946548.722751:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beef1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877943303346816:12345-0@lo:400:kworker.0 Request processed in 46us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946548.722757:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1790946548.722779:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303346944 00000100:00100000:1.0:1790946548.722782:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303346944 00000100:00100000:1.0:1790946548.722810:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303347200 00000100:00100000:1.0:1790946548.722812:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303347200 00000100:00100000:1.0:1790946548.722834:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1790946548.722841:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beef0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1877943303346944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946548.722874:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beef0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1877943303346944:12345-0@lo:400:kworker.0 Request processed in 33us (981us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946548.722880:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1790946548.722893:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1790946548.722899:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beef3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3302:x1877943303347200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946548.722928:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beef3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3302:x1877943303347200:12345-0@lo:400:kworker.0 Request processed in 30us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946548.722934:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1790946548.722992:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146beef1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1877943303346816:0@lo:400:kworker.0 00000100:00100000:1.0:1790946548.723004:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146beef3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877943303346688:0@lo:400:kworker.0 00000100:00100000:1.0:1790946548.723014:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146beef0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303347200:0@lo:400:kworker.0 00000100:00100000:3.0:1790946548.723149:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beef3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1877943303347072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946548.723186:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beef3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1877943303347072:12345-0@lo:400:kworker.0 Request processed in 837us (1356us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946548.723193:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:3.0:1790946548.723247:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790946548.723252:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790946548.723255:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790946548.723273:0:3301:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1790946548.723281:0:3301:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:3.0:1790946548.723310:0:3301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9146be97b100, transno 4294967304 00000100:00100000:3.0:1790946548.723329:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146beef2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303346944:0@lo:400:kworker.0 00000100:00100000:3.0:1790946548.723341:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146beef2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3301:1877943303346560:0@lo:400:kworker.0 00000100:00100000:3.0:1790946548.724441:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146beef1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1877943303347072:0@lo:400:kworker.0 00010000:00010000:2.0:1790946549.046835:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1790946549.233119:0:7990:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 334304914724ns, next at 335304911651ns, rc = 0 00000100:00100000:0.0:1790946549.233185:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790946549.234354:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be125500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303347328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790946549.234840:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946549.234922:0:6676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303347328 00000100:00100000:0.0:1790946549.234931:0:6676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303347328 00000100:00100000:0.0:1790946549.235556:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1790946549.235572:0:6676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be125f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1877943303347328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790946549.235620:0:6676:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790946549.235709:0:6676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be125f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1877943303347328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 142us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946549.235716:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790946549.236118:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be125500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303347328:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1790946549.306478:0:5857:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967403 is committed 00000001:00080000:3.0:1790946549.306511:0:5857:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:3.0:1790946549.306522:0:5857:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9145879aa9c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1790946549.306528:0:5857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9146b69a1400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9145879aa000 00000020:00080000:3.0:1790946549.306532:0:5857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9146b69a1800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9146813ee800 00000020:00080000:3.0:1790946549.306552:0:5857:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:3.0:1790946549.306588:0:5868:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:3.0:1790946549.306867:0:5868:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:2.0:1790946549.801578:0:7645:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:2.0:1790946549.801595:0:7645:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00010000:00010000:2.0:1790946550.070950:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790946550.640735:0:11687:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790946550.640749:0:11687:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790946550.640819:0:11687:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1790946550.640827:0:11687:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1790946551.088493:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946551.280596:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be849880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303347456:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790946551.280706:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946551.280995:0:6676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303347456 00000100:00100000:1.0:1790946551.281023:0:6676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303347456 00000100:00100000:1.0:1790946551.281116:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790946551.281128:0:6676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be124a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303347456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790946551.281175:0:6676:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790946551.282225:0:6676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be124a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303347456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1076us (1495us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946551.282239:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:0.0:1790946551.282506:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790946551.282557:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be849880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303347456:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1790946552.116557:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946552.529065:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946552.529280:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286560384 00000100:00100000:1.0:1790946552.529293:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286560384 00000100:00080000:0.0:1790946552.529352:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790946552.529382:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 135 00000100:00100000:1.0:1790946552.529395:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be127800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+13:10231:x1877943286560384:12345-192.168.203.13@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1790946552.529544:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be127800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+13:10231:x1877943286560384:12345-192.168.203.13@tcp:60:lhsmtool_posix.0 Request processed in 151us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946552.529553:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 135 00000100:00100000:1.0:1790946552.535744:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946552.536973:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286560640 00000100:00100000:3.0:1790946552.537005:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286560640 00000100:00100000:3.0:1790946552.537132:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 35 00000100:00100000:3.0:1790946552.537144:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468e93c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+13:10231:x1877943286560640:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1790946552.537617:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468e93c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+14:10231:x1877943286560640:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 474us (1887us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1790946552.537626:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 35 00010000:00010000:2.0:1790946553.136880:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946553.570925:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946553.570986:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946553.571016:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946553.571038:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946553.571094:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946553.571123:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286560768 00000100:00100000:2.0:1790946553.571136:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286560768 00000100:00100000:2.0:1790946553.571237:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 294 00000100:00100000:2.0:1790946553.571248:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:2364:x1877943286560768:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790946553.571336:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:2364:x1877943286560768:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 90us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946553.571345:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 294 00000100:00100000:2.0:1790946553.571394:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286561024 00000100:00100000:2.0:1790946553.571398:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286561024 00000100:00100000:2.0:1790946553.571438:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286561152 00000100:00100000:2.0:1790946553.571441:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286561152 00000100:00100000:2.0:1790946553.571465:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 80 00000100:00100000:2.0:1790946553.571472:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be849c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+5:2364:x1877943286561024:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790946553.571505:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be849c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+5:2364:x1877943286561024:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 33us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946553.571511:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 80 00000100:00100000:2.0:1790946553.571523:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 81 00000100:00100000:2.0:1790946553.571530:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be849180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2363:x1877943286561152:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790946553.571541:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286560896 00000100:00100000:1.0:1790946553.571545:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286560896 00000100:00100000:2.0:1790946553.571554:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be849180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2363:x1877943286561152:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 25us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946553.571560:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 81 00000100:00100000:1.0:1790946553.571577:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286561280 00000100:00100000:1.0:1790946553.571580:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286561280 00000100:00100000:2.0:1790946553.571582:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 145 00000100:00100000:2.0:1790946553.571588:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be849880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+14:2363:x1877943286560896:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790946553.571600:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 146 00000100:00100000:1.0:1790946553.571606:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914698017480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+5:2364:x1877943286561280:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790946553.571621:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be849880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+14:2363:x1877943286560896:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 33us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946553.571628:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 145 00000100:00100000:1.0:1790946553.571631:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914698017480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+5:2364:x1877943286561280:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 25us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946553.571637:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 146 00000100:00080000:2.0:1790946553.573725:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790946553.573738:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790946553.573741:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790946553.840586:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914698017800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303347968:0@lo:400:kworker.0 00000100:00100000:2.0:1790946553.840666:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946553.840696:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914698015500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3301:1877943303347584:0@lo:400:kworker.0 00000100:00100000:2.0:1790946553.840744:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914698015f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877943303347712:0@lo:400:kworker.0 00000100:00100000:3.0:1790946553.840750:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946553.840779:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914698016680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1877943303348096:0@lo:400:kworker.0 00000100:00100000:2.0:1790946553.840813:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946553.840825:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303347584 00000100:00100000:3.0:1790946553.840834:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303347584 00000100:00100000:2.0:1790946553.840847:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914698016d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303348224:0@lo:400:kworker.0 00000100:00100000:3.0:1790946553.840879:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1790946553.840880:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946553.840891:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3301:x1877943303347584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946553.840905:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790946553.840913:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914698014a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1877943303347840:0@lo:400:kworker.0 00000100:00100000:2.0:1790946553.840939:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946553.840962:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3301:x1877943303347584:12345-0@lo:400:kworker.0 Request processed in 72us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946553.840970:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1790946553.840982:0:12075:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303347968 00000100:00100000:2.0:1790946553.840988:0:12075:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303347968 00000100:00100000:3.0:1790946553.841008:0:11315:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303347712 00000100:00100000:3.0:1790946553.841012:0:11315:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303347712 00000100:00100000:3.0:1790946553.841039:0:11315:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303347840 00000100:00100000:3.0:1790946553.841043:0:11315:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303347840 00000100:00100000:2.0:1790946553.841044:0:12075:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303348224 00000100:00100000:2.0:1790946553.841049:0:12075:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303348224 00000100:00100000:3.0:1790946553.841071:0:11315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1790946553.841079:0:11315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914698014e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877943303347712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946553.841086:0:12075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1790946553.841096:0:12075:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914698015180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303347968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946553.841120:0:11315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914698014e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877943303347712:12345-0@lo:400:kworker.0 Request processed in 43us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946553.841127:0:11315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1790946553.841142:0:11315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1790946553.841147:0:12075:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914698015180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303347968:12345-0@lo:400:kworker.0 Request processed in 52us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946553.841154:0:12075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1790946553.841170:0:12075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1790946553.841175:0:11315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914698017b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877943303347840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946553.841182:0:12075:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914698016300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303348224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946553.841234:0:11315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914698017b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877943303347840:12345-0@lo:400:kworker.0 Request processed in 64us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946553.841240:0:11315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1790946553.841256:0:12075:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914698016300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303348224:12345-0@lo:400:kworker.0 Request processed in 76us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946553.841264:0:12075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:2.0:1790946553.841292:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790946553.841296:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790946553.841298:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790946553.841312:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946553.841355:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914698015500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3301:1877943303347584:0@lo:400:kworker.0 00000100:00100000:2.0:1790946553.841386:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914698017800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303347968:0@lo:400:kworker.0 00000100:00100000:2.0:1790946553.841413:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914698014a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1877943303347840:0@lo:400:kworker.0 00000100:00100000:2.0:1790946553.841421:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914698015f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877943303347712:0@lo:400:kworker.0 00000100:00100000:2.0:1790946553.841427:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:2.0:1790946553.841431:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9146beef0a80, transno 4294967310 00000004:00080000:2.0:1790946553.841441:0:3302:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:2.0:1790946553.841452:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914698016d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303348224:0@lo:400:kworker.0 00000100:00100000:3.0:1790946553.842287:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303348096 00000100:00100000:3.0:1790946553.842295:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303348096 00000100:00100000:3.0:1790946553.842339:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1790946553.842348:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914698015880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1877943303348096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946553.842551:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914698015880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1877943303348096:12345-0@lo:400:kworker.0 Request processed in 204us (1236us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946553.842558:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:2.0:1790946553.843190:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790946553.843272:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914698016680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1877943303348096:0@lo:400:kworker.0 00010000:00010000:2.0:1790946554.165682:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1790946554.358053:0:7990:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 339429847734ns, next at 340429844748ns, rc = 0 00000100:00100000:2.0:1790946554.358140:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be126680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303348352:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790946554.358268:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946554.359456:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303348352 00000100:00100000:0.0:1790946554.359479:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303348352 00000100:00100000:0.0:1790946554.359616:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1790946554.359629:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914698016680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877943303348352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790946554.359688:0:6678:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790946554.359778:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914698016680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877943303348352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 152us (1510us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946554.359786:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1790946554.360852:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be126680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303348352:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1790946554.368760:0:12365:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 09:09:12 (1790946552) 00000004:00080000:2.0:1790946554.452769:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000001:00080000:2.0:1790946554.452814:0:5857:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:2.0:1790946554.452824:0:5857:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000100:00100000:0.0:1790946554.452952:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790946554.452981:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be126d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303348480:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1790946554.453142:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946554.453258:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303348480 00000100:00100000:0.0:1790946554.453268:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303348480 00000020:00080000:3.0:1790946554.453279:0:5868:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1790946554.453330:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790946554.453340:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be125180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1877943303348480:12345-0@lo:2:osp-syn-1-0.0 00000020:00080000:3.0:1790946554.453422:0:5868:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00002000:00010000:0.0:1790946554.455892:0:6673:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1790946554.455905:0:6673:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1790946543 -> 1790946543 00002000:00010000:0.0:1790946554.455908:0:6673:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 1790946542 -> 1790946542 00002000:00010000:0.0:1790946554.455911:0:6673:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1790946543 -> 1790946543 00002000:00010000:0.0:1790946554.455914:0:6673:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1790946554.456036:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be125180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3301:x1877943303348480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2690us (2887us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1790946554.456049:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000004:00080000:2.0:1790946554.458543:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9146be126d80/2, rc 0, transno 4294967313 00000100:00100000:2.0:1790946554.458567:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be126d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303348480:0@lo:2:osp-syn-1-0.0 00000001:00080000:2.0:1790946554.995785:0:7645:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00010000:00010000:2.0:1790946555.193506:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946555.859628:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946555.859962:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286561536 00000100:00100000:3.0:1790946555.859977:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286561536 00000100:00080000:2.0:1790946555.860198:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790946555.860319:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 136 00000100:00100000:3.0:1790946555.860333:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468e93d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+13:11298:x1877943286561536:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790946555.860363:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946555.860404:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a200/0x16e41aef932725c0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0ce57 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946555.860510:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef932725c7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946555.860528:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef932725c7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946555.860540:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef932725c7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946555.860576:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef932725ce lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946555.860584:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef932725ce lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946555.860590:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef932725ce lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946555.860944:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef932725d5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946555.860955:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef932725d5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946555.860964:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef932725d5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790946555.860976:0:5835:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1790946555.861170:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef932725c7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946555.861179:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef932725c7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946555.861187:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef932725c7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946555.861194:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146a032a400 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946555.861236:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef932725c7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946555.861257:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef932725c7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946555.861272:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9146836dfd00) 00010000:00010000:3.0:1790946555.861276:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946555.861282:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef932725c7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946555.861287:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef932725c7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946555.861303:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef932725ce lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946555.861309:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef932725ce lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946555.861314:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef932725ce lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946555.861319:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146a032b400 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946555.861321:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef932725ce lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946555.861326:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef932725ce lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946555.861333:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9146836df800) 00010000:00010000:3.0:1790946555.861335:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946555.861338:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef932725ce lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946555.861354:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef932725ce lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946555.861913:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a200/0x16e41aef932725c0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce57 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946555.861933:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef932725d5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce57 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946555.861941:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9146a0a5e900) 00010000:00010000:3.0:1790946555.861944:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946555.861947:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146a032ae00, rc 0) 00000100:00100000:3.0:1790946555.862047:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468e93d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+15:11298:x1877943286561536:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 1717us (2432us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1790946555.862057:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 136 00000100:00100000:0.0:1790946555.868097:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946555.868164:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946555.868227:0:5820:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286561792 00000100:00100000:0.0:1790946555.868240:0:5820:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286561792 00000100:00100000:0.0:1790946555.868498:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:0.0:1790946555.868512:0:5820:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be126300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+15:2362:x1877943286561792:12345-192.168.203.13@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1790946555.868518:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286561664 00000100:00100000:3.0:1790946555.868524:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286561664 00010000:00010000:0.0:1790946555.868550:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1790946555.868562:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 137 00000100:00100000:3.0:1790946555.868568:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be124e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+16:11298:x1877943286561664:12345-192.168.203.13@tcp:59:lhsmtool_posix.0 00010000:00010000:0.0:1790946555.868583:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef932725d5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce57 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946555.868606:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9146a0a5e900) 00010000:00010000:0.0:1790946555.868613:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790946555.868689:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be124e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+15:11298:x1877943286561664:12345-192.168.203.13@tcp:59:lhsmtool_posix.0 Request processed in 120us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946555.868699:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 137 00000100:00100000:0.0:1790946555.876257:0:5820:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be126300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+14:2362:x1877943286561792:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 7729us (8074us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946555.876428:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 10 00010000:00010000:2.0:1790946556.213693:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946556.407243:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146beef1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303348608:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790946556.407354:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946556.407569:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303348608 00000100:00100000:3.0:1790946556.407580:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303348608 00000100:00100000:3.0:1790946556.407664:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1790946556.407676:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b79d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1877943303348608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790946556.407740:0:6678:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790946556.407796:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b79d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1877943303348608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946556.407803:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1790946556.408324:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146beef1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303348608:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1790946556.408363:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1790946556.786041:0:11687:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790946556.786054:0:11687:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790946556.786792:0:11687:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1790946556.786804:0:11687:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1790946557.232554:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946558.091811:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946558.091939:0:11315:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286561920 00000100:00100000:0.0:1790946558.091954:0:11315:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286561920 00000100:00100000:0.0:1790946558.092053:0:11315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 138 00000100:00100000:0.0:1790946558.092066:0:11315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beef2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+14:11340:x1877943286561920:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1790946558.092096:0:11315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946558.092124:0:11315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef932725e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0ce5e expref: -99 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.092237:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef932725ea lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.092257:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef932725ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.092274:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef932725ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.092306:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef932725f1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.092333:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef932725f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.092341:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef932725f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.092651:0:11315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef932725ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.092661:0:11315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef932725ea lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.092669:0:11315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef932725ea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.092675:0:11315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1932800 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:0.0:1790946558.092681:0:11315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef932725ea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.092690:0:11315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef932725ea lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.092706:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9146a0a5e400) 00010000:00010000:0.0:1790946558.092710:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790946558.092716:0:11315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef932725ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.092722:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef932725ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.092738:0:11315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef932725f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.092750:0:11315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef932725f1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.092756:0:11315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef932725f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.092760:0:11315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1932400 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:0.0:1790946558.092763:0:11315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef932725f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.092769:0:11315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef932725f1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.092776:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff914686750e00) 00010000:00010000:0.0:1790946558.092779:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790946558.092781:0:11315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef932725f1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.092787:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef932725f1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.092830:0:11315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef932725e3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce5e expref: 15 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.092843:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9146a0a5e400) 00010000:00010000:0.0:1790946558.092845:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790946558.092849:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef932725e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce5e expref: 15 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.092874:0:11315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b1933200, rc 0) 00000100:00100000:0.0:1790946558.092961:0:11315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beef2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+14:11340:x1877943286561920:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 898us (1167us total) trans 0 rc 301/301 00000100:00100000:0.0:1790946558.092971:0:11315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 138 00000100:00080000:3.0:1790946558.093449:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790946558.099066:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946558.099346:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286562176 00000100:00100000:1.0:1790946558.099360:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286562176 00000100:00100000:1.0:1790946558.099477:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 139 00000100:00100000:1.0:1790946558.099490:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beef2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+14:11340:x1877943286562176:12345-192.168.203.13@tcp:36:lfs.0 00010000:00010000:1.0:1790946558.099577:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790946558.099632:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeee00/0x16e41aef93271f6f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc9e expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946558.099658:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9146a0a5e400) 00010000:00010000:1.0:1790946558.099673:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790946558.099957:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef932725f8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946558.099975:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef932725f8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946558.099988:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef932725f8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946558.100002:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef932725ff lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946558.100010:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef932725ff lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946558.100016:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef932725ff lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790946558.101169:0:5835:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1790946558.101194:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef932725f8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946558.101238:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef932725f8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946558.101251:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef932725f8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946558.101258:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180e600 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:1.0:1790946558.101264:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef932725f8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946558.101273:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef932725f8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946558.101289:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91469e29d500) 00010000:00010000:1.0:1790946558.101293:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790946558.101299:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef932725f8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946558.101305:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef932725f8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790946558.101331:0:5835:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000bff71ed0 reply state 000000001cb2f61a transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef932725ff lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946558.101342:0:5835:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790946558.101500:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beef2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+15:11340:x1877943286562176:12345-192.168.203.13@tcp:36:lfs.0 Request processed in 2006us (2445us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1790946558.101511:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 139 00010000:00010000:3.0:1790946558.103244:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef932725ff lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946558.103267:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef932725ff lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946558.103276:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef932725ff lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946558.103376:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180f600 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946558.103381:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef932725ff lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946558.103391:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef932725ff lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946558.103412:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff91469e29df00) 00010000:00010000:3.0:1790946558.103416:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946558.103422:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef932725ff lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946558.103430:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef932725ff lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946558.214266:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946558.214369:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286562304 00000100:00100000:3.0:1790946558.214382:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286562304 00000100:00100000:3.0:1790946558.214451:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 140 00000100:00100000:3.0:1790946558.214463:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beef1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+14:11348:x1877943286562304:12345-192.168.203.13@tcp:101:lctl.0 00010000:00010000:3.0:1790946558.214496:0:6803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946558.214526:0:6803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93272606 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0ce65 expref: -99 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946558.215533:0:6803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a200/0x16e41aef9327260d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946558.215556:0:6803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a200/0x16e41aef9327260d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946558.215570:0:6803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a200/0x16e41aef9327260d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790946558.215690:0:6803:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790946558.215696:0:6803:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790946558.215730:0:6803:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a200/0x16e41aef9327260d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946558.215770:0:6803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93272606 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce65 expref: 16 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946558.215788:0:6803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a200/0x16e41aef9327260d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce65 expref: 15 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946558.215812:0:6803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9146836df800) 00010000:00010000:3.0:1790946558.215815:0:6803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790946558.215819:0:6803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146a032a200, rc 0) 00000100:00100000:3.0:1790946558.215962:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beef1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+15:11348:x1877943286562304:12345-192.168.203.13@tcp:101:lctl.0 Request processed in 1500us (1709us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946558.215972:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 140 00010000:00010000:1.0:1790946558.257546:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946558.308186:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946558.308347:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286562432 00000100:00100000:0.0:1790946558.308361:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286562432 00000100:00100000:0.0:1790946558.308443:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 141 00000100:00100000:0.0:1790946558.308454:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914698016d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+15:11354:x1877943286562432:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:0.0:1790946558.308483:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946558.308512:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272614 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0ce6c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.308601:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef9327261b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.308629:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef9327261b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.308645:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef9327261b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.308663:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef93272622 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.308670:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef93272622 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.308677:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef93272622 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.308830:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef93272629 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.308839:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef93272629 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.308847:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef93272629 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790946558.308880:0:5836:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1790946558.308884:0:5836:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790946558.308907:0:5836:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef93272629 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.308919:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef9327261b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.308926:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef9327261b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.308933:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef9327261b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.308939:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1932800 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:0.0:1790946558.308945:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef9327261b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.308953:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef9327261b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.308966:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9146836df800) 00010000:00010000:0.0:1790946558.308975:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790946558.308982:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef9327261b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.308988:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef9327261b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.309006:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef93272622 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.309010:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef93272622 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.309016:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef93272622 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.309021:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1933a00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:0.0:1790946558.309024:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef93272622 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.309030:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef93272622 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.309037:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff914686750e00) 00010000:00010000:0.0:1790946558.309039:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790946558.309042:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef93272622 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.309054:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef93272622 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.309090:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272614 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce6c expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.309117:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef93272629 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce6c expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.309124:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff914686750d00) 00010000:00010000:0.0:1790946558.309127:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1790946558.309129:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b1933200, rc 0) 00000100:00100000:0.0:1790946558.309278:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914698016d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+16:11354:x1877943286562432:12345-192.168.203.13@tcp:101:bash.0 Request processed in 825us (1106us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946558.309286:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 141 00000100:00100000:0.0:1790946558.313299:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946558.313455:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286562688 00000100:00100000:1.0:1790946558.313469:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286562688 00000100:00100000:1.0:1790946558.313554:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 142 00000100:00100000:1.0:1790946558.313566:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be127b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+16:11354:x1877943286562688:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:1.0:1790946558.313595:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946558.313637:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272630 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0ce73 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946558.313811:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef93272637 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946558.313830:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef93272637 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946558.313844:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef93272637 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946558.313860:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327263e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946558.313867:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327263e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946558.313873:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327263e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790946558.315480:0:5835:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:0.0:1790946558.315949:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272645 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.315970:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272645 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.315983:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272645 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.316043:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef93272637 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.316053:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef93272637 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.316060:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef93272637 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.316083:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180fc00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:0.0:1790946558.316089:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef93272637 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.316098:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef93272637 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.316115:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff914686750d00) 00010000:00010000:0.0:1790946558.316118:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790946558.316124:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef93272637 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.316130:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef93272637 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790946558.316149:0:5835:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b6d7632b reply state 00000000a0a3e9b9 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327263e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946558.316160:0:5835:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790946558.316296:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272630 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce73 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.316315:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272645 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce73 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.316324:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff914686750e00) 00010000:00010000:0.0:1790946558.316326:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790946558.316330:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b1932400, rc 0) 00000100:00100000:0.0:1790946558.316464:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be127b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+19:11354:x1877943286562688:12345-192.168.203.13@tcp:101:bash.0 Request processed in 2897us (3189us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1790946558.316483:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 142 00010000:00010000:0.0:1790946558.321677:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327263e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.321704:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327263e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.321714:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327263e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.321721:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180fa00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:0.0:1790946558.321728:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327263e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.321737:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327263e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.321759:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91469e29d500) 00010000:00010000:0.0:1790946558.321762:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790946558.321768:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327263e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.321775:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327263e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946558.322864:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946558.323441:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286562816 00000100:00100000:2.0:1790946558.323457:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286562816 00000100:00100000:2.0:1790946558.323553:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 48 00000100:00100000:2.0:1790946558.323563:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be125880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+5:2361:x1877943286562816:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:2.0:1790946558.323587:0:6675:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946558.323623:0:6675:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007434a79/0x16e41aef93272653 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0ce7a expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790946558.323669:0:6675:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790946558.323696:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=343s v=(0 0) 00010000:00010000:2.0:1790946558.323703:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790946558.323715:0:6675:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007434a79/0x16e41aef93272653 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce7a expref: 6 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946558.323738:0:6675:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000007434a79/0x16e41aef93272653 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce7a expref: 6 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946558.323754:0:6675:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914688aef400, rc 0) 00000100:00100000:2.0:1790946558.323850:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be125880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2361:x1877943286562816:12345-192.168.203.13@tcp:101:bash.0 Request processed in 288us (999us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946558.323859:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 48 00000100:00080000:3.0:1790946558.324053:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790946558.332699:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946558.332833:0:6808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286562944 00000100:00100000:2.0:1790946558.332848:0:6808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286562944 00000100:00100000:2.0:1790946558.332924:0:6808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 49 00000100:00100000:2.0:1790946558.332954:0:6808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468e93f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:11354:x1877943286562944:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:2.0:1790946558.332981:0:6808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946558.333005:0:6808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085a6e26c/0x16e41aef9327265a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0ce81 expref: -99 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946558.333045:0:6808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000007434a79/0x16e41aef93272653 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce7a expref: 7 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946558.333055:0:6808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790946558.333060:0:6808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790946558.333065:0:6808:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085a6e26c/0x16e41aef9327265a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce81 expref: 7 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946558.333109:0:6808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000007434a79/0x16e41aef93272653 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce7a expref: 7 pid: 6675 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946558.333126:0:6808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000007434a79/0x16e41aef93272653 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce7a expref: 7 pid: 6675 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946558.333144:0:6808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914698015f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6808:1877943303348736:192.168.203.13@tcp:104: 00000100:00100000:2.0:1790946558.333292:0:6808:0:(client.c:2716:ptlrpc_set_wait()) set ffff914698befcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790946558.337101:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946558.337267:0:5821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286563072 00000100:00100000:0.0:1790946558.337286:0:5821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286563072 00010000:00010000:1.0:1790946558.337520:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000007434a79/0x16e41aef93272653 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce7a expref: 8 pid: 6675 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946558.337607:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 61 00000100:00100000:1.0:1790946558.337640:0:5821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468e93d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+8:2363:x1877943286563072:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790946558.337659:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790946558.337686:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000007434a79/0x16e41aef93272653 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce7a expref: 8 pid: 6675 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946558.337701:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000007434a79/0x16e41aef93272653 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce7a expref: 8 pid: 6675 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946558.337728:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946558.337733:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946558.337741:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000085a6e26c/0x16e41aef9327265a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce81 expref: 8 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946558.337750:0:5821:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085a6e26c/0x16e41aef9327265a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce81 expref: 8 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946558.337995:0:5821:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000085a6e26c/0x16e41aef9327265a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce81 expref: 8 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946558.338011:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be97b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5821:1877943303348864:192.168.203.13@tcp:105: 00010000:00010000:2.0:1790946558.338073:0:6808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007434a79/0x16e41aef93272653 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce7a expref: 8 pid: 6675 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946558.338088:0:6808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914698015f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6808:1877943303348736:192.168.203.13@tcp:104: 00010000:00010000:2.0:1790946558.338124:0:6808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000085a6e26c/0x16e41aef9327265a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce81 expref: 7 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946558.338135:0:6808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914688aeec00, rc 0) 00000100:00100000:1.0:1790946558.338303:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set ffff914684eb86c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790946558.338901:0:6808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468e93f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+7:11354:x1877943286562944:12345-192.168.203.13@tcp:101:bash.0 Request processed in 5946us (6214us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946558.338909:0:6808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 49 00000100:00100000:1.0:1790946558.352891:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946558.353180:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286563328 00000100:00100000:0.0:1790946558.353194:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286563328 00000100:00100000:0.0:1790946558.353584:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 36 00000100:00100000:0.0:1790946558.353636:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be97aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+18:11354:x1877943286563328:12345-192.168.203.13@tcp:35:bash.0 00000100:00100000:3.0:1790946558.357527:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be97b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5821:1877943303348864:192.168.203.13@tcp:105: 00010000:00010000:3.0:1790946558.357568:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790946558.357691:0:5821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468e93d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2363:x1877943286563072:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 20073us (20597us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946558.357705:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 61 00000100:00100000:1.0:1790946558.362783:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be97aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+19:11354:x1877943286563328:12345-192.168.203.13@tcp:35:bash.0 Request processed in 9136us (11678us total) trans 4294967419 rc 0/0 00000100:00100000:1.0:1790946558.362820:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 36 00000100:00100000:1.0:1790946558.469431:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946558.469597:0:11315:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286563584 00000100:00100000:3.0:1790946558.469610:0:11315:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286563584 00000100:00100000:3.0:1790946558.469697:0:11315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 143 00000100:00100000:3.0:1790946558.469709:0:11315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be97b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+19:11364:x1877943286563584:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1790946558.469744:0:11315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946558.469774:0:11315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93272661 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0ce88 expref: -99 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790946558.469908:0:11315:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1790946558.470089:0:11315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93272661 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce88 expref: 21 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946558.470106:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9146836df800) 00010000:00010000:3.0:1790946558.470426:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790946558.470437:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93272661 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce88 expref: 21 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946558.470456:0:11315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146a032b400, rc 0) 00000100:00100000:3.0:1790946558.470550:0:11315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be97b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+20:11364:x1877943286563584:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 842us (1131us total) trans 4294967420 rc 301/301 00000100:00100000:3.0:1790946558.470559:0:11315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 143 00000100:00100000:3.0:1790946558.474188:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946558.474862:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286563840 00000100:00100000:2.0:1790946558.474878:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286563840 00000100:00100000:2.0:1790946558.474959:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 37 00000100:00100000:2.0:1790946558.474972:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beef1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+20:11364:x1877943286563840:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:2.0:1790946558.476022:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beef1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+21:11364:x1877943286563840:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 1047us (1843us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1790946558.476038:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 37 00000100:00100000:2.0:1790946558.558416:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946558.558644:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286563968 00000100:00100000:3.0:1790946558.558660:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286563968 00000100:00100000:3.0:1790946558.558746:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 144 00000100:00100000:3.0:1790946558.558758:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914698015f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+21:11370:x1877943286563968:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1790946558.558793:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946558.558822:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef9327266f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0ce8f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946558.558912:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef93272676 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946558.558929:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef93272676 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946558.558943:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef93272676 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790946558.558990:0:5834:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1790946558.558995:0:5834:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790946558.559020:0:5834:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef93272676 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946558.559070:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef9327266f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce8f expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946558.559094:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef93272676 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce8f expref: 22 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946558.559104:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff914686750d00) 00010000:00010000:3.0:1790946558.559108:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790946558.559112:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146a032a400, rc 0) 00000100:00100000:3.0:1790946558.559489:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914698015f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+22:11370:x1877943286563968:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 730us (1084us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946558.559497:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 144 00000100:00100000:1.0:1790946558.568634:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946558.569199:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286564224 00000100:00100000:0.0:1790946558.569255:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286564224 00000100:00100000:0.0:1790946558.569476:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 145 00000100:00100000:0.0:1790946558.569644:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be97b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+22:11370:x1877943286564224:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1790946558.569678:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946558.569707:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef9327267d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0ce96 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.569967:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272684 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.569986:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272684 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.570000:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272684 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790946558.570015:0:5835:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1790946558.570356:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef9327267d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce96 expref: 25 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.570455:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272684 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce96 expref: 24 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.570468:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff914686750e00) 00010000:00010000:0.0:1790946558.570471:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790946558.570475:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b1933800, rc 0) 00000100:00100000:0.0:1790946558.570698:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be97b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+24:11370:x1877943286564224:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 1210us (2088us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1790946558.570725:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 145 00000100:00100000:1.0:1790946558.575123:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946558.575309:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286564480 00000100:00100000:0.0:1790946558.575324:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286564480 00000100:00100000:0.0:1790946558.575408:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 146 00000100:00100000:0.0:1790946558.575421:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146becb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+24:11370:x1877943286564480:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1790946558.575456:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946558.575726:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef93272692 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0ce9d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.575881:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cb200/0x16e41aef93272699 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.575900:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cb200/0x16e41aef93272699 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.575914:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cb200/0x16e41aef93272699 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790946558.575928:0:5836:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1790946558.576096:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef93272692 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce9d expref: 27 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.576121:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cb200/0x16e41aef93272699 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce9d expref: 26 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.576131:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff914686750e00) 00010000:00010000:0.0:1790946558.576134:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1790946558.576138:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146c20cb200, rc 0) 00000100:00100000:0.0:1790946558.577240:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146becb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+26:11370:x1877943286564480:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 1815us (2125us total) trans 4294967423 rc 0/0 00000100:00100000:0.0:1790946558.577251:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 146 00000100:00100000:2.0:1790946558.581956:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946558.582051:0:5820:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286564608 00000100:00100000:0.0:1790946558.582065:0:5820:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286564608 00000100:00100000:0.0:1790946558.582157:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:0.0:1790946558.582169:0:5820:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914698014a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+26:2364:x1877943286564608:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790946558.582190:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790946558.582260:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272684 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce96 expref: 26 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.582295:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff914686750e00) 00010000:00010000:0.0:1790946558.582302:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790946558.582385:0:5820:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914698014a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+25:2364:x1877943286564608:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 211us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946558.582393:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:3.0:1790946558.586916:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946558.587007:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286564736 00000100:00100000:0.0:1790946558.587020:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286564736 00000100:00100000:0.0:1790946558.587109:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 50 00000100:00100000:0.0:1790946558.587120:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beef0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2364:x1877943286564736:12345-192.168.203.13@tcp:1:lfs.0 00010000:00010000:0.0:1790946558.587194:0:6673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000267d32e3/0x16e41aef932726a7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.587268:0:6673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000085a6e26c/0x16e41aef9327265a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce81 expref: 6 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.587286:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946558.587309:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790946558.587315:0:6673:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000267d32e3/0x16e41aef932726a7 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.587359:0:6673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000085a6e26c/0x16e41aef9327265a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce81 expref: 6 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.587673:0:6673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000085a6e26c/0x16e41aef9327265a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce81 expref: 6 pid: 6808 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946558.587697:0:6673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be126a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6673:1877943303348992:192.168.203.13@tcp:104: 00000100:00100000:0.0:1790946558.587838:0:6673:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146be9aa900 going to sleep for 11 seconds 00000100:00100000:0.0:1790946558.591797:0:6673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be126a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6673:1877943303348992:192.168.203.13@tcp:104: 00010000:00010000:0.0:1790946558.591843:0:6673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000267d32e3/0x16e41aef932726a7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946558.592758:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946558.592972:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286564864 00000100:00100000:1.0:1790946558.592985:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286564864 00002000:00100000:1.0:1790946558.593055:0:6680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9146beef0700 x1877943286564864/t0(0) o4->7eed1f4b-bd5b-4a70-8045-59db065b3dfc@192.168.203.13@tcp:499/0 lens 504/0 e 0 to 0 dl 1790946569 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790946558.593068:0:6680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9146beef0700 with x1877943286564864 ext(0->12) 00010000:00010000:1.0:1790946558.593080:0:6680:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000085a6e26c/0x16e41aef9327265a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce81 expref: 7 pid: 6808 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946558.593100:0:6680:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000085a6e26c/0x16e41aef9327265a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce81 expref: 7 pid: 6808 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790946558.593109:0:6680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9146beef0700 00000100:00100000:1.0:1790946558.593153:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 2 00000100:00100000:1.0:1790946558.593164:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beef0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+7:2363:x1877943286564864:12345-192.168.203.13@tcp:4:lfs.0 00000100:00100000:1.0:1790946558.594164:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beef0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+9:2363:x1877943286564864:12345-192.168.203.13@tcp:4:lfs.0 Request processed in 993us (1408us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1790946558.594177:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 2 00002000:00100000:1.0:1790946558.594188:0:6680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9146beef0700 x1877943286564864/t4294967305(0) o4->7eed1f4b-bd5b-4a70-8045-59db065b3dfc@192.168.203.13@tcp:499/0 lens 504/448 e 0 to 0 dl 1790946569 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790946558.594227:0:6680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9146beef0700 with x1877943286564864 ext(0->12) 00010000:00010000:1.0:1790946558.594250:0:6680:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000085a6e26c/0x16e41aef9327265a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce81 expref: 9 pid: 6808 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946558.594270:0:6680:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000085a6e26c/0x16e41aef9327265a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce81 expref: 9 pid: 6808 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790946558.594279:0:6680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9146beef0700 00000100:00100000:3.0:1790946558.598105:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946558.598703:0:5821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286564992 00000100:00100000:1.0:1790946558.598717:0:5821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286564992 00010000:00010000:1.0:1790946558.598780:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000085a6e26c/0x16e41aef9327265a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce81 expref: 9 pid: 6808 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946558.600790:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 62 00000100:00100000:1.0:1790946558.600823:0:5821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beef3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+9:2361:x1877943286564992:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790946558.600861:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1790946558.600890:0:5821:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1790946558.600894:0:5821:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1790946557 00002000:00010000:1.0:1790946558.600897:0:5821:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1790946558 00002000:00010000:1.0:1790946558.600899:0:5821:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1790946557 00010000:00010000:1.0:1790946558.600908:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000085a6e26c/0x16e41aef9327265a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce81 expref: 9 pid: 6808 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946558.600930:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000085a6e26c/0x16e41aef9327265a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce81 expref: 9 pid: 6808 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946558.600965:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085a6e26c/0x16e41aef9327265a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce81 expref: 9 pid: 6808 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946558.601014:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790946558.601020:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790946558.601027:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000267d32e3/0x16e41aef932726a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946558.601039:0:5821:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000267d32e3/0x16e41aef932726a7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946558.601131:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790946558.601324:0:5821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beef3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+8:2361:x1877943286564992:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 518us (3234us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946558.601334:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 62 00010000:00010000:2.0:1790946558.601902:0:6673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000267d32e3/0x16e41aef932726a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946558.601917:0:6673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000267d32e3/0x16e41aef932726a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946558.601953:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000267d32e3/0x16e41aef932726a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946558.601963:0:6673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000267d32e3/0x16e41aef932726a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946558.601983:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000267d32e3/0x16e41aef932726a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946558.601991:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146c20cb600 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:2.0:1790946558.601995:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000267d32e3/0x16e41aef932726a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946558.602006:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000267d32e3/0x16e41aef932726a7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946558.602023:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000267d32e3/0x16e41aef932726a7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946558.602031:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000267d32e3/0x16e41aef932726a7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946558.602224:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beef0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+7:2364:x1877943286564736:12345-192.168.203.13@tcp:1:lfs.0 Request processed in 15083us (15298us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946558.602235:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 50 00000100:00100000:2.0:1790946558.605114:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946558.605386:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286565248 00000100:00100000:1.0:1790946558.605401:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286565248 00000100:00100000:2.0:1790946558.605487:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 38 00000100:00100000:2.0:1790946558.605502:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b2650050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+25:11370:x1877943286565248:12345-192.168.203.13@tcp:35:lfs.0 00000004:00010000:2.0:1790946558.605593:0:5838:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cb200/0x16e41aef93272699 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce9d expref: 25 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790946558.606067:0:5838:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1790946558.606117:0:5838:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:2.0:1790946558.607425:0:5838:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967426 00010000:00010000:2.0:1790946558.607542:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef932726ae lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946558.607563:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272645 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce73 expref: 29 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946558.607572:0:5838:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef932726ae lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946558.607621:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272645 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce73 expref: 29 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946558.607639:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272645 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce73 expref: 29 pid: 5835 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946558.607654:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914698017800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5838:1877943303349120:192.168.203.13@tcp:104: 00000100:00100000:2.0:1790946558.607735:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff914698befcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790946558.611365:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946558.611756:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914698017800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5838:1877943303349120:192.168.203.13@tcp:104: 00010000:00010000:2.0:1790946558.611794:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef932726ae lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946558.613528:0:5819:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286565376 00000100:00100000:1.0:1790946558.613549:0:5819:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286565376 00010000:00010000:1.0:1790946558.613639:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272645 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce73 expref: 30 pid: 5835 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946558.613697:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 63 00000100:00100000:1.0:1790946558.613710:0:5819:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beef1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+30:2363:x1877943286565376:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790946558.613733:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790946558.613741:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272645 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce73 expref: 30 pid: 5835 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946558.613756:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272645 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce73 expref: 30 pid: 5835 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946558.613803:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272645 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce73 expref: 30 pid: 5835 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946558.613829:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff914686750e00) 00010000:00010000:1.0:1790946558.613835:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef932726ae lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946558.613847:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef932726ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946558.613857:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef932726ae lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946558.613898:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790946558.613992:0:5819:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beef1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+29:2363:x1877943286565376:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 284us (2643us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946558.614000:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 63 00010000:00010000:2.0:1790946558.614157:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef932726ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946558.614167:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef932726ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790946558.614391:0:5838:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967427 00000001:00080000:2.0:1790946558.614656:0:5838:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1790946558.614790:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914698017800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5838:1877943303349248:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1790946558.615114:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946558.615176:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff914698bef3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790946558.615252:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303349248 00000100:00100000:1.0:1790946558.615260:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303349248 00000100:00080000:2.0:1790946558.615312:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790946558.615326:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790946558.615336:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914698015500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5838:x1877943303349248:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1790946558.615438:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914698015500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5838:x1877943303349248:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 104us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946558.615447:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790946558.615536:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914698017800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5838:1877943303349248:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1790946558.616257:0:5838:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:0.0:1790946558.616345:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be126a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5838:1877943303349376:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1790946558.616414:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946558.616445:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146be9aa3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790946558.616470:0:5840:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303349376 00000100:00100000:3.0:1790946558.616478:0:5840:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303349376 00000100:00100000:3.0:1790946558.616523:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790946558.616532:0:5840:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be125c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5838:x1877943303349376:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1790946558.617697:0:5840:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be125c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5838:x1877943303349376:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 1156us (1272us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1790946558.617711:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790946558.618003:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be126a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5838:1877943303349376:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1790946558.618097:0:5838:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:0.0:1790946558.618380:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef932726ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.618416:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef932726ae lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.618425:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef932726ae lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.618431:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aefc00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:0.0:1790946558.618437:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef932726ae lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.618445:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef932726ae lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.618464:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff914686750e00) 00010000:00010000:0.0:1790946558.618468:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1790946558.618474:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef932726ae lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.618480:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef932726ae lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790946558.618754:0:5838:0:(mdd_object.c:4180:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1790946558.619421:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:0.0:1790946558.619436:0:5838:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 343691234601ns, next at 344691231863ns, rc = 0 00000001:00080000:0.0:1790946558.619448:0:5838:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:0.0:1790946558.619498:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff914686750e00) 00010000:00010000:0.0:1790946558.619502:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1790946558.619513:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cb200/0x16e41aef93272699 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce9d expref: 33 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946558.619699:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b2650050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+32:11370:x1877943286565248:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 14200us (14598us total) trans 4294967432 rc 0/0 00000100:00100000:0.0:1790946558.619711:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 38 00000020:00080000:0.0:1790946558.619717:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1790946558.623654:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946558.624232:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286565504 00000100:00100000:0.0:1790946558.624246:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286565504 00000100:00100000:0.0:1790946558.624416:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 147 00000100:00100000:0.0:1790946558.624427:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beef1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+32:11370:x1877943286565504:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1790946558.624458:0:6803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946558.624488:0:6803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cb600/0x16e41aef932726b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cea4 expref: -99 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.624572:0:6803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cb600/0x16e41aef932726b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cea4 expref: 33 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.624588:0:6803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cb600/0x16e41aef932726b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cea4 expref: 33 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.624623:0:6803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff914686750200) 00010000:00010000:0.0:1790946558.624627:0:6803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790946558.624631:0:6803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146c20cb600, rc 0) 00000100:00100000:0.0:1790946558.624719:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beef1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+33:11370:x1877943286565504:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 293us (1081us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946558.624727:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 147 00000100:00100000:3.0:1790946558.628490:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946558.632418:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286565760 00000100:00100000:1.0:1790946558.632442:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286565760 00000100:00100000:1.0:1790946558.632660:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 39 00000100:00100000:1.0:1790946558.632675:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b68ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+33:11370:x1877943286565760:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:1.0:1790946558.633188:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b68ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+34:11370:x1877943286565760:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 514us (4714us total) trans 4294967433 rc 0/0 00000100:00100000:1.0:1790946558.633511:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 39 00000100:00100000:2.0:1790946558.687533:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946558.687575:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946558.687636:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946558.687679:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946558.688818:0:12075:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286566144 00000100:00100000:3.0:1790946558.688867:0:12075:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286566144 00000100:00100000:3.0:1790946558.688958:0:12075:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286566016 00000100:00100000:3.0:1790946558.688962:0:12075:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286566016 00000100:00100000:3.0:1790946558.688996:0:12075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 84 00000100:00100000:3.0:1790946558.689006:0:12075:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914698016a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2361:x1877943286566144:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790946558.689107:0:12075:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914698016a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2361:x1877943286566144:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 102us (1530us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946558.689115:0:12075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 84 00000100:00100000:3.0:1790946558.689136:0:12075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 85 00000100:00100000:3.0:1790946558.689142:0:12075:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914698015c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+7:2361:x1877943286566016:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790946558.689171:0:12075:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914698015c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+7:2361:x1877943286566016:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 29us (1535us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946558.689177:0:12075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 85 00000100:00100000:0.0:1790946558.689296:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286565888 00000100:00100000:0.0:1790946558.689304:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286565888 00000100:00100000:0.0:1790946558.689361:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 296 00000100:00100000:0.0:1790946558.689369:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:2361:x1877943286565888:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1790946558.689400:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:2361:x1877943286565888:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 33us (1882us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946558.689407:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 296 00000100:00080000:2.0:1790946558.689542:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790946558.689560:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286566272 00000100:00100000:0.0:1790946558.689566:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286566272 00000100:00100000:0.0:1790946558.689634:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 150 00000100:00100000:0.0:1790946558.689641:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914698014700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+5:2361:x1877943286566272:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1790946558.689677:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914698014700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+5:2361:x1877943286566272:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 36us (1997us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946558.689683:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 150 00000100:00080000:0.0:1790946558.689700:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790946558.719385:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946558.719548:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286566528 00000100:00100000:0.0:1790946558.719561:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286566528 00000100:00100000:0.0:1790946558.719648:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 148 00000100:00100000:0.0:1790946558.719660:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b68a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+34:11380:x1877943286566528:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1790946558.719694:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946558.719719:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cb200/0x16e41aef932726bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0ceab expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790946558.719958:0:5836:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1790946558.720119:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cb200/0x16e41aef932726bc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ceab expref: 36 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.720136:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9146836df800) 00010000:00010000:0.0:1790946558.720156:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790946558.720163:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cb200/0x16e41aef932726bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ceab expref: 36 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.720182:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146c20cb200, rc 0) 00000100:00100000:0.0:1790946558.720455:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b68a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+35:11380:x1877943286566528:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 795us (1085us total) trans 4294967434 rc 301/301 00000100:00100000:0.0:1790946558.720464:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 148 00000100:00100000:3.0:1790946558.730356:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946558.730752:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286566656 00000100:00100000:0.0:1790946558.730766:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286566656 00000100:00100000:0.0:1790946558.730858:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 149 00000100:00100000:0.0:1790946558.730870:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b68ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+35:11380:x1877943286566656:12345-192.168.203.13@tcp:34:lfs.0 00010000:00010000:0.0:1790946558.730977:0:6803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cb200/0x16e41aef932726ca lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.730998:0:6803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cb200/0x16e41aef932726ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.731012:0:6803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cb200/0x16e41aef932726ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.731028:0:6803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef932726d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.731035:0:6803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef932726d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.731041:0:6803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef932726d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.731153:0:6803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef932726d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.731181:0:6803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef932726d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.731189:0:6803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef932726d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790946558.731292:0:6803:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef932726d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.731307:0:6803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cb200/0x16e41aef932726ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.731315:0:6803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cb200/0x16e41aef932726ca lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.731323:0:6803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cb200/0x16e41aef932726ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.731329:0:6803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146c20cb200 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:0.0:1790946558.731335:0:6803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cb200/0x16e41aef932726ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.731343:0:6803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cb200/0x16e41aef932726ca lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.731357:0:6803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff914686750d00) 00010000:00010000:0.0:1790946558.731360:0:6803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790946558.731365:0:6803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cb200/0x16e41aef932726ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.731372:0:6803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cb200/0x16e41aef932726ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.731394:0:6803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef932726d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.731400:0:6803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef932726d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.731406:0:6803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef932726d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.731412:0:6803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1932400 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:0.0:1790946558.731415:0:6803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef932726d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.731421:0:6803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef932726d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.731429:0:6803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff914686750e00) 00010000:00010000:0.0:1790946558.731432:0:6803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790946558.731435:0:6803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef932726d1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.731441:0:6803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef932726d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.731460:0:6803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef932726d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.731467:0:6803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef932726d8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.731473:0:6803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef932726d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.731483:0:6803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1933800 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:0.0:1790946558.731487:0:6803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef932726d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.731493:0:6803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef932726d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.731501:0:6803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff914686750200) 00010000:00010000:0.0:1790946558.731503:0:6803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790946558.731506:0:6803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef932726d8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.731512:0:6803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef932726d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946558.731625:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b68ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+35:11380:x1877943286566656:12345-192.168.203.13@tcp:34:lfs.0 Request processed in 756us (1281us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946558.731633:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 149 00000100:00100000:3.0:1790946558.737485:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946558.737656:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286566912 00000100:00100000:2.0:1790946558.737670:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286566912 00000100:00100000:2.0:1790946558.737982:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 40 00000100:00100000:2.0:1790946558.737995:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b68a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+35:11380:x1877943286566912:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:2.0:1790946558.738379:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b68a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+36:11380:x1877943286566912:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 385us (911us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1790946558.738389:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 40 00000100:00100000:3.0:1790946558.785829:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946558.786016:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286567168 00000100:00100000:2.0:1790946558.786030:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286567168 00000100:00100000:2.0:1790946558.786110:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 150 00000100:00100000:2.0:1790946558.786122:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5fddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+36:11383:x1877943286567168:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1790946558.786156:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946558.786187:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef932726df lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0ceb2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946558.786580:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef932726e6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946558.786600:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef932726e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946558.786625:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef932726e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946558.786645:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef932726ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946558.786652:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef932726ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946558.786660:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef932726ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946558.786809:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefa00/0x16e41aef932726f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946558.786818:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefa00/0x16e41aef932726f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946558.786826:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefa00/0x16e41aef932726f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790946558.786836:0:5834:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1790946558.791457:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef932726e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946558.791483:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef932726e6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946558.791517:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef932726e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946558.791524:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aef200 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:2.0:1790946558.791530:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef932726e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946558.791540:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef932726e6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946558.791562:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff914686750d00) 00010000:00010000:2.0:1790946558.791566:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790946558.791572:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef932726e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946558.791580:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef932726e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946558.791605:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef932726ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946558.791624:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef932726ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946558.791630:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef932726ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946558.791636:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aee600 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:2.0:1790946558.791639:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef932726ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946558.791657:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef932726ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946558.791667:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9146a0a5e300) 00010000:00010000:2.0:1790946558.791670:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790946558.791673:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef932726ed lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946558.791680:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef932726ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946558.791772:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef932726df lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ceb2 expref: 39 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946558.791791:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefa00/0x16e41aef932726f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ceb2 expref: 38 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946558.791799:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff914686750200) 00010000:00010000:2.0:1790946558.791802:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790946558.791805:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914688aefa00, rc 0) 00000100:00100000:2.0:1790946558.793075:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5fddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+38:11383:x1877943286567168:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 6941us (7247us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1790946558.793090:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 150 00000100:00100000:3.0:1790946558.797075:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946558.797242:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286567296 00000100:00100000:0.0:1790946558.797268:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286567296 00000100:00100000:0.0:1790946558.797355:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 151 00000100:00100000:0.0:1790946558.797366:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5fdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+38:11383:x1877943286567296:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:0.0:1790946558.797472:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272702 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.797497:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272702 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.797512:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272702 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.797564:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272702 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.797572:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272702 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.797579:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272702 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.797585:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1933800 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:0.0:1790946558.797590:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272702 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.797598:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272702 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.797630:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff914686750200) 00010000:00010000:0.0:1790946558.797633:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790946558.797639:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272702 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946558.797644:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272702 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946558.797748:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5fdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+38:11383:x1877943286567296:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 379us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946558.797757:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 151 00000100:00100000:3.0:1790946558.801423:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946558.801558:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286567552 00000100:00100000:2.0:1790946558.801571:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286567552 00000100:00100000:2.0:1790946558.801660:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 41 00000100:00100000:2.0:1790946558.801670:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5fdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+38:11383:x1877943286567552:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:2.0:1790946558.802133:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5fdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+39:11383:x1877943286567552:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 462us (721us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1790946558.802142:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 41 00000100:00100000:3.0:1790946558.961972:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5fdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1877943303349760:0@lo:400:kworker.0 00000100:00100000:3.0:1790946558.962066:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946558.962153:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790946558.962160:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5fdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303349888:0@lo:400:kworker.0 00000100:00100000:2.0:1790946558.962445:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303349760 00000100:00100000:2.0:1790946558.962458:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303349760 00000100:00100000:2.0:1790946558.962532:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1790946558.962542:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682ead500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1877943303349760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946558.962625:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682ead500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1877943303349760:12345-0@lo:400:kworker.0 Request processed in 84us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946558.962633:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1790946558.962813:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946558.962879:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5fdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1877943303349760:0@lo:400:kworker.0 00000100:00100000:2.0:1790946558.962987:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303349888 00000100:00100000:2.0:1790946558.962993:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303349888 00000100:00100000:2.0:1790946558.963028:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1790946558.963035:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3300:x1877943303349888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946558.963073:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3300:x1877943303349888:12345-0@lo:400:kworker.0 Request processed in 38us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946558.963080:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1790946558.963149:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5fded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3302:1877943303349504:0@lo:400:kworker.0 00000100:00100000:0.0:1790946558.963238:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946558.963413:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303349504 00000100:00100000:2.0:1790946558.963418:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303349504 00000100:00100000:2.0:1790946558.963444:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1790946558.963450:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3302:x1877943303349504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946558.963482:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3302:x1877943303349504:12345-0@lo:400:kworker.0 Request processed in 33us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946558.963489:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00080000:2.0:1790946558.963524:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790946558.963687:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5fded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3302:1877943303349504:0@lo:400:kworker.0 00000100:00100000:0.0:1790946558.963695:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914682eae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1877943303350016:0@lo:400:kworker.0 00000100:00100000:0.0:1790946558.963724:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946558.963760:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1790946558.963767:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877943303349632:0@lo:400:kworker.0 00000100:00100000:0.0:1790946558.963789:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946558.963808:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914682eac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303350144:0@lo:400:kworker.0 00000100:00100000:0.0:1790946558.963833:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946558.963932:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303350144 00000100:00100000:0.0:1790946558.963936:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303350144 00000100:00100000:0.0:1790946558.963973:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1790946558.963978:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be125f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303350144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946558.964015:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be125f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303350144:12345-0@lo:400:kworker.0 Request processed in 36us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946558.964020:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:0.0:1790946558.964036:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790946558.964056:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:0.0:1790946558.964062:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9146be126d80, transno 4294967313 00000100:00100000:0.0:1790946558.964072:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914682eac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303350144:0@lo:400:kworker.0 00000100:00100000:1.0:1790946558.964331:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303350016 00000100:00100000:1.0:1790946558.964337:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303350016 00000100:00100000:1.0:1790946558.964375:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303349632 00000100:00100000:1.0:1790946558.964378:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303349632 00000100:00100000:1.0:1790946558.964397:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1790946558.964404:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be124700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877943303350016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946558.964453:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be124700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877943303350016:12345-0@lo:400:kworker.0 Request processed in 48us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946558.964459:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1790946558.964472:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1790946558.964478:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be127100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877943303349632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946558.964503:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be127100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877943303349632:12345-0@lo:400:kworker.0 Request processed in 25us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946558.964508:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:1.0:1790946558.964522:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790946558.964550:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877943303349632:0@lo:400:kworker.0 00000100:00100000:1.0:1790946558.964560:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914682eae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1877943303350016:0@lo:400:kworker.0 00000100:00100000:3.0:1790946558.965571:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5fdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303349888:0@lo:400:kworker.0 00000100:00100000:2.0:1790946559.078327:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946559.078526:0:11315:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286567808 00000100:00100000:3.0:1790946559.078540:0:11315:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286567808 00000100:00100000:3.0:1790946559.078618:0:11315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 152 00000100:00100000:3.0:1790946559.078629:0:11315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914698017100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+39:11414:x1877943286567808:12345-192.168.203.13@tcp:101:cat.0 00010000:00010000:3.0:1790946559.078663:0:11315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946559.078688:0:11315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93272709 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0ceb9 expref: -99 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946559.078809:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93272710 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946559.078827:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93272710 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946559.078852:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93272710 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790946559.078865:0:11315:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1790946559.079022:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93272709 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ceb9 expref: 42 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946559.079042:0:11315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93272710 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ceb9 expref: 41 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946559.079051:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff914686750200) 00010000:00010000:3.0:1790946559.079054:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790946559.079058:0:11315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146a032bc00, rc 0) 00000100:00100000:3.0:1790946559.079134:0:11315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914698017100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+41:11414:x1877943286567808:12345-192.168.203.13@tcp:101:cat.0 Request processed in 506us (822us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1790946559.079156:0:11315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 152 00000100:00100000:3.0:1790946559.084440:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946559.084656:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286568064 00000100:00100000:2.0:1790946559.084670:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286568064 00000100:00100000:2.0:1790946559.084742:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 42 00000100:00100000:2.0:1790946559.084752:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+41:11414:x1877943286568064:12345-192.168.203.13@tcp:35:cat.0 00000100:00100000:2.0:1790946559.085155:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+42:11414:x1877943286568064:12345-192.168.203.13@tcp:35:cat.0 Request processed in 403us (731us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1790946559.085164:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 42 00000100:00100000:2.0:1790946559.089155:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946559.089313:0:5821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286568192 00000100:00100000:1.0:1790946559.089325:0:5821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286568192 00000100:00100000:1.0:1790946559.089408:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:1.0:1790946559.089420:0:5821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914685711450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+42:2363:x1877943286568192:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790946559.089440:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790946559.089490:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93272710 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ceb9 expref: 42 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946559.089513:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff914686750200) 00010000:00010000:1.0:1790946559.089520:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790946559.089593:0:5821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914685711450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+41:2363:x1877943286568192:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 177us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946559.089601:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:3.0:1790946559.158979:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946559.159105:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286568448 00000100:00100000:1.0:1790946559.159119:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286568448 00000100:00100000:1.0:1790946559.159429:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 153 00000100:00100000:1.0:1790946559.159444:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5fdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+41:11420:x1877943286568448:12345-192.168.203.13@tcp:101:dd.0 00010000:00010000:1.0:1790946559.159479:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946559.159483:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1790946559.159521:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef93272676 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce8f expref: 41 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946559.159546:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff914686750d00) 00010000:00010000:1.0:1790946559.159551:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790946559.159569:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef9327271e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cec0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946559.159726:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef93272725 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946559.159743:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefa00/0x16e41aef932726f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ceb2 expref: 41 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946559.159772:0:5835:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef93272725 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946559.159815:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefa00/0x16e41aef932726f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ceb2 expref: 41 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946559.159830:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefa00/0x16e41aef932726f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ceb2 expref: 41 pid: 5834 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946559.159860:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146becb5500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5835:1877943303350272:192.168.203.13@tcp:104: 00000100:00100000:1.0:1790946559.159982:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff914684eb8180 going to sleep for 11 seconds 00000100:00100000:1.0:1790946559.164064:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146becb5500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5835:1877943303350272:192.168.203.13@tcp:104: 00010000:00010000:1.0:1790946559.164110:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef93272725 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946559.164122:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946559.164247:0:5819:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286568576 00000100:00100000:0.0:1790946559.164256:0:5819:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286568576 00010000:00010000:0.0:1790946559.164320:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefa00/0x16e41aef932726f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ceb2 expref: 42 pid: 5834 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946559.164358:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 64 00000100:00100000:0.0:1790946559.164369:0:5819:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5fdd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+42:2363:x1877943286568576:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790946559.164407:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790946559.164416:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefa00/0x16e41aef932726f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ceb2 expref: 42 pid: 5834 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946559.164430:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefa00/0x16e41aef932726f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ceb2 expref: 42 pid: 5834 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946559.164459:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefa00/0x16e41aef932726f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ceb2 expref: 42 pid: 5834 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946559.164478:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff914686750200) 00010000:00010000:0.0:1790946559.164483:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef93272725 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946559.164494:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef93272725 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946559.164502:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef93272725 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946559.164525:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790946559.164589:0:5819:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5fdd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+41:2363:x1877943286568576:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 221us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946559.164596:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 64 00010000:00010000:2.0:1790946559.164796:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef93272725 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946559.164805:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef93272725 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790946559.164828:0:5835:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1790946559.165037:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef9327271e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cec0 expref: 42 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946559.165058:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef93272725 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cec0 expref: 41 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946559.165066:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff914686750200) 00010000:00010000:2.0:1790946559.165069:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790946559.165072:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b180fc00, rc 0) 00000100:00100000:2.0:1790946559.165112:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5fdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+41:11420:x1877943286568448:12345-192.168.203.13@tcp:101:dd.0 Request processed in 5674us (6150us total) trans 4294967440 rc 0/0 00000100:00100000:2.0:1790946559.165121:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 153 00000100:00100000:3.0:1790946559.169484:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946559.169536:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286568832 00000100:00100000:0.0:1790946559.169550:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286568832 00000100:00100000:0.0:1790946559.169690:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 154 00000100:00100000:0.0:1790946559.169703:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5fded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+41:11420:x1877943286568832:12345-192.168.203.13@tcp:36:dd.0 00010000:00010000:0.0:1790946559.170481:0:6803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272733 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946559.170507:0:6803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272733 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946559.170520:0:6803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272733 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790946559.170587:0:6803:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967441 00000004:00010000:0.0:1790946559.170726:0:6803:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000045a6fee9 reply state 00000000a6988ddc transno 4294967442 ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272733 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946559.170739:0:6803:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790946559.171009:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5fded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+44:11420:x1877943286568832:12345-192.168.203.13@tcp:36:dd.0 Request processed in 1304us (1533us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1790946559.171020:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 154 00000020:00080000:0.0:1790946559.171028:0:6803:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790946559.172688:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272733 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946559.172710:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272733 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946559.172719:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272733 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946559.172726:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1933800 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:0.0:1790946559.172732:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272733 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946559.172751:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272733 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946559.172792:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff914686750200) 00010000:00010000:0.0:1790946559.172796:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790946559.172802:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272733 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946559.172809:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272733 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946559.281306:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946559.396445:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946559.397765:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286568960 00000100:00100000:1.0:1790946559.397786:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286568960 00000100:00100000:1.0:1790946559.397933:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 155 00000100:00100000:1.0:1790946559.397947:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5fdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+43:11434:x1877943286568960:12345-192.168.203.13@tcp:101:stat.0 00010000:00010000:1.0:1790946559.397982:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946559.398011:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef9327273a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cec7 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946559.398101:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272741 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946559.398119:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272741 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946559.398152:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272741 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946559.398170:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93272748 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946559.398178:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93272748 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946559.398185:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93272748 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946559.398355:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327274f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946559.398367:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef93272725 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cec0 expref: 44 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946559.398376:0:5836:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327274f lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946559.398419:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef93272725 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cec0 expref: 44 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946559.398451:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef93272725 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cec0 expref: 44 pid: 5835 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946559.398470:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146becb5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5836:1877943303350400:192.168.203.13@tcp:104: 00000100:00100000:1.0:1790946559.398598:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff914684eb8180 going to sleep for 11 seconds 00000100:00100000:1.0:1790946559.405527:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146becb5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5836:1877943303350400:192.168.203.13@tcp:104: 00010000:00010000:1.0:1790946559.405571:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327274f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946559.409138:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946559.409646:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286569216 00000100:00100000:2.0:1790946559.409688:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286569216 00000100:00100000:2.0:1790946559.409768:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 43 00000100:00100000:2.0:1790946559.409780:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146befb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+45:5599:x1877943286569216:12345-192.168.203.13@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1790946559.410273:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146befb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+46:5599:x1877943286569216:12345-192.168.203.13@tcp:35:ldlm_bl.0 Request processed in 493us (1147us total) trans 4294967443 rc 0/0 00000100:00100000:2.0:1790946559.410281:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 43 00000100:00100000:3.0:1790946559.415858:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946559.416019:0:5820:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286569344 00000100:00100000:0.0:1790946559.416031:0:5820:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286569344 00010000:00010000:0.0:1790946559.416084:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef93272725 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cec0 expref: 46 pid: 5835 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946559.416197:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 65 00000100:00100000:0.0:1790946559.416275:0:5820:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146befb0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+46:2363:x1877943286569344:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790946559.416308:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790946559.416318:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef93272725 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cec0 expref: 46 pid: 5835 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946559.416345:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef93272725 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cec0 expref: 46 pid: 5835 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946559.416373:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef93272725 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cec0 expref: 46 pid: 5835 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946559.416396:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff914686750200) 00010000:00010000:0.0:1790946559.416402:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327274f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946559.416433:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327274f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946559.416442:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327274f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946559.416483:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790946559.416556:0:5820:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146befb0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+45:2363:x1877943286569344:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 295us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946559.416564:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 65 00010000:00010000:2.0:1790946559.417496:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327274f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946559.417511:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327274f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790946559.417577:0:5836:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1790946559.417583:0:5836:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790946559.417624:0:5836:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327274f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946559.417644:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327274f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946559.417657:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272741 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946559.417665:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272741 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946559.417673:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272741 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946559.417680:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180e600 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:2.0:1790946559.417686:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272741 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946559.417786:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272741 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946559.417802:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff914686750d00) 00010000:00010000:2.0:1790946559.417805:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790946559.417810:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272741 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946559.417817:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272741 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946559.417833:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93272748 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946559.417901:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93272748 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946559.417908:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93272748 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946559.417913:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180f600 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:2.0:1790946559.417917:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93272748 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946559.417923:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93272748 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946559.417932:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91469e29d000) 00010000:00010000:2.0:1790946559.417935:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790946559.417938:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93272748 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946559.417955:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93272748 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946559.418009:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef9327273a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cec7 expref: 45 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946559.418027:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327274f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cec7 expref: 44 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946559.418034:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff914686750200) 00010000:00010000:2.0:1790946559.418036:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790946559.418039:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b180fa00, rc 0) 00000100:00100000:2.0:1790946559.418830:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5fdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+44:11434:x1877943286568960:12345-192.168.203.13@tcp:101:stat.0 Request processed in 20881us (22394us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946559.418906:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 155 00000100:00100000:0.0:1790946559.475225:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be126d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303350528:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790946559.475332:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946559.475454:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303350528 00000100:00100000:0.0:1790946559.475465:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303350528 00000100:00100000:0.0:1790946559.475537:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1790946559.475550:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be124a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303350528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790946559.475615:0:6678:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790946559.475674:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be124a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303350528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946559.475683:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1790946559.475762:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be126d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303350528:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790946559.525321:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946559.525486:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286569600 00000100:00100000:2.0:1790946559.525500:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286569600 00000100:00100000:2.0:1790946559.526257:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 156 00000100:00100000:2.0:1790946559.526273:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be126d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+44:11440:x1877943286569600:12345-192.168.203.13@tcp:36:truncate.0 00010000:00010000:2.0:1790946559.526354:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790946559.526391:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327274f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cec7 expref: 44 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946559.526747:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff914686750200) 00010000:00010000:2.0:1790946559.526753:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790946559.528935:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93272756 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946559.528975:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93272756 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946559.528988:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93272756 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790946559.529093:0:5835:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967444 00000004:00010000:2.0:1790946559.529231:0:5835:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000005cc4ff93 reply state 000000009ca218d5 transno 4294967445 ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93272756 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946559.529241:0:5835:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790946559.530445:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be126d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+46:11440:x1877943286569600:12345-192.168.203.13@tcp:36:truncate.0 Request processed in 4163us (5124us total) trans 4294967445 rc 0/0 00000100:00100000:2.0:1790946559.530459:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 156 00000020:00080000:2.0:1790946559.530469:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790946559.537406:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93272756 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946559.537430:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93272756 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946559.537439:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93272756 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946559.537446:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aee600 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:1.0:1790946559.537452:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93272756 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946559.537461:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93272756 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946559.537482:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff914686750200) 00010000:00010000:1.0:1790946559.537485:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790946559.537492:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93272756 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946559.537498:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93272756 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790946559.596699:0:5857:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967442 is committed 00000004:00080000:2.0:1790946559.596738:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1790946559.596774:0:5857:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9146be9aad80 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1790946559.596780:0:5857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff914685666500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9146be9aa900 00000020:00080000:2.0:1790946559.596783:0:5857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff914685666300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9146b660a000 00000004:00080000:2.0:1790946559.596810:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000001:00080000:2.0:1790946559.596842:0:5857:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967443 is committed 00000020:00080000:3.0:1790946559.598598:0:5868:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1790946559.598937:0:5868:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1790946559.599296:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790946559.599324:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be126680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303350656:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1790946559.599709:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946559.599811:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303350656 00000100:00100000:0.0:1790946559.599838:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303350656 00000100:00100000:0.0:1790946559.599899:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1790946559.599908:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be125500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3300:x1877943303350656:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1790946559.599945:0:6674:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:0.0:1790946559.599987:0:6674:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6abfacfd, atime: 0x6abfacfe, ctime: 0x6abfacfd, blocks: 0x1 00010000:00010000:0.0:1790946559.599997:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ebdc405/0x16e41aef9327275d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946559.600018:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=344s v=(0 0) 00010000:00010000:0.0:1790946559.600022:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946559.600030:0:6674:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ebdc405/0x16e41aef9327275d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946559.600049:0:6674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ebdc405/0x16e41aef9327275d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946559.601256:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ebdc405/0x16e41aef9327275d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946559.601461:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ebdc405/0x16e41aef9327275d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946559.601494:0:6674:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790946559.602238:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946559.602250:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ebdc405/0x16e41aef9327275d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946559.602263:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1933a00 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:2.0:1790946559.602280:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ebdc405/0x16e41aef9327275d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946559.602304:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ebdc405/0x16e41aef9327275d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946559.602328:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ebdc405/0x16e41aef9327275d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946559.602335:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ebdc405/0x16e41aef9327275d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946559.602360:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946559.602362:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946559.602364:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946559.604676:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be125500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3300:x1877943303350656:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4755us (4955us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1790946559.604693:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000004:00080000:1.0:1790946559.605473:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9146be126680/2, rc 0, transno 4294967307 00000100:00100000:1.0:1790946559.605487:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be126680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303350656:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1790946559.740873:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946559.741895:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286569728 00000100:00100000:3.0:1790946559.741914:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286569728 00000100:00100000:3.0:1790946559.742078:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 157 00000100:00100000:3.0:1790946559.742090:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be126300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+17:11455:x1877943286569728:12345-192.168.203.13@tcp:101:stat.0 00010000:00010000:3.0:1790946559.744574:0:6803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946559.744638:0:6803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93272764 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cece expref: -99 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946559.744745:0:6803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef9327276b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946559.744766:0:6803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef9327276b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946559.744781:0:6803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef9327276b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946559.744825:0:6803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef93272772 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946559.744834:0:6803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef93272772 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946559.744841:0:6803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef93272772 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946559.746672:0:6803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef93272779 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946559.746701:0:6803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef93272779 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946559.746717:0:6803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef93272779 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790946559.746780:0:6803:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1790946559.746785:0:6803:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790946559.746818:0:6803:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef93272779 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946559.746832:0:6803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef93272779 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946559.746842:0:6803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef9327276b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946559.746850:0:6803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef9327276b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946559.746871:0:6803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef9327276b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946559.746877:0:6803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146a032b400 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946559.746882:0:6803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef9327276b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946559.746891:0:6803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef9327276b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946559.746905:0:6803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff914686750d00) 00010000:00010000:3.0:1790946559.746908:0:6803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946559.746913:0:6803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef9327276b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946559.746919:0:6803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef9327276b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946559.746934:0:6803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef93272772 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946559.746940:0:6803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef93272772 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946559.746945:0:6803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef93272772 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946559.746950:0:6803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146a032ae00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946559.746953:0:6803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef93272772 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946559.746967:0:6803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef93272772 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946559.746975:0:6803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9146836df400) 00010000:00010000:3.0:1790946559.746977:0:6803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946559.746980:0:6803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef93272772 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946559.746986:0:6803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef93272772 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946559.747034:0:6803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93272764 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cece expref: 19 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946559.747051:0:6803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef93272779 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cece expref: 18 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946559.747069:0:6803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff914686750200) 00010000:00010000:3.0:1790946559.747071:0:6803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790946559.747073:0:6803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146a032a400, rc 0) 00000100:00100000:3.0:1790946559.748835:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be126300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+18:11455:x1877943286569728:12345-192.168.203.13@tcp:101:stat.0 Request processed in 6733us (7962us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946559.748850:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 157 00000100:00100000:0.0:1790946559.865169:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946559.865539:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286569984 00000100:00100000:2.0:1790946559.865554:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286569984 00000100:00100000:2.0:1790946559.865643:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 158 00000100:00100000:2.0:1790946559.865654:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682eae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+18:11465:x1877943286569984:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1790946559.865684:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946559.865713:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef93272780 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0ced5 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790946559.865842:0:5836:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1790946559.866031:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef93272780 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ced5 expref: 20 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946559.866052:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9146836df800) 00010000:00010000:2.0:1790946559.866073:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790946559.866104:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef93272780 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ced5 expref: 20 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946559.866126:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914688aef800, rc 0) 00000100:00100000:2.0:1790946559.866544:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682eae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+19:11465:x1877943286569984:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 890us (1389us total) trans 4294967446 rc 301/301 00000100:00100000:2.0:1790946559.866553:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 158 00000100:00100000:0.0:1790946559.876878:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946559.877108:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286570240 00000100:00100000:2.0:1790946559.877122:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286570240 00000100:00100000:2.0:1790946559.877240:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 44 00000100:00100000:2.0:1790946559.877253:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b2650850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+19:11465:x1877943286570240:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:2.0:1790946559.877648:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b2650850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+20:11465:x1877943286570240:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 397us (785us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1790946559.877657:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 44 00000100:00100000:3.0:1790946559.944816:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946559.945006:0:11315:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286570496 00000100:00100000:0.0:1790946559.945019:0:11315:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286570496 00000100:00100000:0.0:1790946559.945095:0:11315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 159 00000100:00100000:0.0:1790946559.945108:0:11315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146befb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+20:11471:x1877943286570496:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:0.0:1790946559.945141:0:11315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946559.945169:0:11315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef9327278e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cedc expref: -99 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946559.945342:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272795 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946559.945360:0:11315:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef93272779 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cece expref: 21 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946559.945370:0:11315:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272795 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946559.945415:0:11315:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef93272779 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cece expref: 21 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946559.945432:0:11315:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef93272779 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cece expref: 21 pid: 6803 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946559.945448:0:11315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914682eac380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11315:1877943303350784:192.168.203.13@tcp:104: 00000100:00100000:0.0:1790946559.945563:0:11315:0:(client.c:2716:ptlrpc_set_wait()) set ffff91468298f780 going to sleep for 11 seconds 00000100:00100000:3.0:1790946559.948191:0:11315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914682eac380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11315:1877943303350784:192.168.203.13@tcp:104: 00010000:00010000:3.0:1790946559.948261:0:11315:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272795 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946559.950372:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946559.951138:0:5821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286570624 00000100:00100000:1.0:1790946559.951177:0:5821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286570624 00010000:00010000:1.0:1790946559.951334:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef93272779 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cece expref: 22 pid: 6803 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946559.951457:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 66 00000100:00100000:1.0:1790946559.951469:0:5821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146befb2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+22:2363:x1877943286570624:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790946559.951491:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790946559.951499:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef93272779 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cece expref: 22 pid: 6803 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946559.951514:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef93272779 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cece expref: 22 pid: 6803 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946559.951547:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef93272779 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cece expref: 22 pid: 6803 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946559.951568:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff914686750200) 00010000:00010000:1.0:1790946559.951574:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272795 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946559.951586:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272795 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946559.951619:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272795 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946559.951657:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790946559.951746:0:5821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146befb2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+21:2363:x1877943286570624:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 280us (1388us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946559.951765:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 66 00010000:00010000:3.0:1790946559.952908:0:11315:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272795 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946559.952926:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272795 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790946559.952955:0:11315:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1790946559.953185:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef9327278e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cedc expref: 22 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946559.953262:0:11315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272795 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cedc expref: 21 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946559.953280:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff914686750200) 00010000:00010000:3.0:1790946559.953284:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790946559.953288:0:11315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b1932400, rc 0) 00000100:00100000:3.0:1790946559.953365:0:11315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146befb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+21:11471:x1877943286570496:12345-192.168.203.13@tcp:101:bash.0 Request processed in 8259us (8566us total) trans 4294967448 rc 0/0 00000100:00100000:3.0:1790946559.953375:0:11315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 159 00000100:00100000:2.0:1790946559.956824:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946559.957272:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286570880 00000100:00100000:3.0:1790946559.957288:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286570880 00000100:00100000:3.0:1790946559.957364:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 160 00000100:00100000:3.0:1790946559.957375:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914698014380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+21:11471:x1877943286570880:12345-192.168.203.13@tcp:36:bash.0 00010000:00010000:3.0:1790946559.957771:0:6803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef932727a3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946559.957816:0:6803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef932727a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946559.957832:0:6803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef932727a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790946559.959547:0:6803:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967449 00000004:00010000:3.0:1790946559.960018:0:6803:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000006d59ca45 reply state 00000000a98e8fc7 transno 4294967450 ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef932727a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946559.960037:0:6803:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790946559.960250:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914698014380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+24:11471:x1877943286570880:12345-192.168.203.13@tcp:36:bash.0 Request processed in 2872us (3437us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1790946559.960260:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 160 00000020:00080000:3.0:1790946559.963950:0:6803:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790946559.965133:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef932727a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946559.965154:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef932727a3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946559.965164:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef932727a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946559.965172:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146a032bc00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946559.965178:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef932727a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946559.965189:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef932727a3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946559.965297:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff914686750200) 00010000:00010000:3.0:1790946559.965301:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946559.965307:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef932727a3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946559.965314:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef932727a3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946559.967713:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946559.968011:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286571008 00000100:00100000:1.0:1790946559.968028:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286571008 00000100:00100000:1.0:1790946559.968110:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 161 00000100:00100000:1.0:1790946559.968124:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914698014000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+23:11471:x1877943286571008:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:1.0:1790946559.968163:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946559.968191:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef932727aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cee3 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946559.968363:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef932727b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946559.968380:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272795 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cedc expref: 24 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946559.968390:0:5835:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef932727b1 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946559.968441:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272795 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cedc expref: 24 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946559.968459:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272795 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cedc expref: 24 pid: 11315 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946559.968478:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146becb5500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5835:1877943303350912:192.168.203.13@tcp:104: 00000100:00100000:1.0:1790946559.968609:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff914684eb8180 going to sleep for 11 seconds 00000100:00100000:2.0:1790946559.971942:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946559.972095:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146becb5500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5835:1877943303350912:192.168.203.13@tcp:104: 00010000:00010000:1.0:1790946559.972151:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef932727b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946559.973427:0:5820:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286571136 00000100:00100000:0.0:1790946559.973461:0:5820:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286571136 00010000:00010000:0.0:1790946559.973518:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272795 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cedc expref: 25 pid: 11315 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946559.973738:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 67 00000100:00100000:0.0:1790946559.973750:0:5820:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914698014a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+25:2363:x1877943286571136:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790946559.973772:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790946559.973781:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272795 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cedc expref: 25 pid: 11315 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946559.973799:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272795 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cedc expref: 25 pid: 11315 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946559.973826:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272795 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cedc expref: 25 pid: 11315 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946559.973862:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff914686750200) 00010000:00010000:0.0:1790946559.973868:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef932727b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946559.973880:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef932727b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946559.973888:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef932727b1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946559.973927:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790946559.974071:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef932727b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946559.974081:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef932727b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790946559.974142:0:5835:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1790946559.974148:0:5835:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790946559.974176:0:5835:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef932727b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946559.974241:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef932727aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cee3 expref: 25 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946559.974281:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef932727b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cee3 expref: 24 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946559.974289:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff914686750200) 00010000:00010000:2.0:1790946559.974292:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790946559.974294:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b180f600, rc 0) 00000100:00100000:0.0:1790946559.974360:0:5820:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914698014a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+24:2363:x1877943286571136:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 611us (2432us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946559.974379:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 67 00000100:00100000:2.0:1790946559.974708:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914698014000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+23:11471:x1877943286571008:12345-192.168.203.13@tcp:101:bash.0 Request processed in 6587us (7010us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946559.974716:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 161 00000100:00100000:3.0:1790946559.978534:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946559.978709:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286571392 00000100:00100000:0.0:1790946559.978723:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286571392 00000100:00100000:0.0:1790946559.978800:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 45 00000100:00100000:0.0:1790946559.978812:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146befb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+23:11471:x1877943286571392:12345-192.168.203.13@tcp:35:bash.0 00000100:00100000:0.0:1790946559.979496:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146befb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+24:11471:x1877943286571392:12345-192.168.203.13@tcp:35:bash.0 Request processed in 684us (975us total) trans 4294967451 rc 0/0 00000100:00100000:0.0:1790946559.979506:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 45 00000100:00100000:3.0:1790946560.067418:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946560.067610:0:11315:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286571648 00000100:00100000:0.0:1790946560.067625:0:11315:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286571648 00000100:00100000:0.0:1790946560.067727:0:11315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 162 00000100:00100000:0.0:1790946560.067741:0:11315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914685636a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+24:11481:x1877943286571648:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1790946560.067777:0:11315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946560.067804:0:11315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef932727b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0ceea expref: -99 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790946560.067958:0:11315:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1790946560.068119:0:11315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef932727b8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ceea expref: 26 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946560.068135:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9146836df800) 00010000:00010000:0.0:1790946560.068138:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790946560.068144:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef932727b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ceea expref: 26 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946560.068164:0:11315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b1932400, rc 0) 00000100:00100000:0.0:1790946560.068380:0:11315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914685636a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+25:11481:x1877943286571648:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 642us (977us total) trans 4294967452 rc 301/301 00000100:00100000:0.0:1790946560.068389:0:11315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 162 00000100:00080000:1.0:1790946560.068473:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790946560.073160:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946560.073302:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286571776 00000100:00100000:3.0:1790946560.073317:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286571776 00000100:00100000:3.0:1790946560.073395:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 163 00000100:00100000:3.0:1790946560.073407:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914698017800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+25:11481:x1877943286571776:12345-192.168.203.13@tcp:34:lfs.0 00010000:00010000:3.0:1790946560.073521:0:6803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef932727c6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.073544:0:6803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef932727c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.073558:0:6803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef932727c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.073581:0:6803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef932727cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.073588:0:6803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef932727cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.073595:0:6803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef932727cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.073966:0:6803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef932727d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.073977:0:6803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef932727d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.073984:0:6803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef932727d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790946560.074038:0:6803:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef932727d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.074052:0:6803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef932727c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.074060:0:6803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef932727c6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.074068:0:6803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef932727c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.074074:0:6803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146a032ae00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946560.074079:0:6803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef932727c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.074088:0:6803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef932727c6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.074101:0:6803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff914686750d00) 00010000:00010000:3.0:1790946560.074104:0:6803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946560.074109:0:6803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef932727c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.074121:0:6803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef932727c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.074136:0:6803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef932727cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.074142:0:6803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef932727cd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.074148:0:6803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef932727cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.074154:0:6803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146a032bc00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946560.074156:0:6803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef932727cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.074162:0:6803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef932727cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.074168:0:6803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9146836df400) 00010000:00010000:3.0:1790946560.074171:0:6803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946560.074173:0:6803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef932727cd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.074179:0:6803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef932727cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.074194:0:6803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef932727d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.074257:0:6803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef932727d4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.074269:0:6803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef932727d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.074275:0:6803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146a032b400 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946560.074278:0:6803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef932727d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.074284:0:6803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef932727d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.074291:0:6803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff914686750200) 00010000:00010000:3.0:1790946560.074293:0:6803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946560.074296:0:6803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef932727d4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.074301:0:6803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef932727d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946560.074400:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914698017800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+25:11481:x1877943286571776:12345-192.168.203.13@tcp:34:lfs.0 Request processed in 994us (1256us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946560.074409:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 163 00000100:00100000:1.0:1790946560.078719:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946560.078846:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286572032 00000100:00100000:2.0:1790946560.078861:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286572032 00000100:00100000:2.0:1790946560.078930:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 46 00000100:00100000:2.0:1790946560.078940:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146becb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+25:11481:x1877943286572032:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:2.0:1790946560.079305:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146becb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+26:11481:x1877943286572032:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 366us (602us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1790946560.079314:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 46 00000100:00100000:0.0:1790946560.107403:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946560.107582:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286572288 00000100:00100000:2.0:1790946560.107611:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286572288 00000100:00100000:2.0:1790946560.107676:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 164 00000100:00100000:2.0:1790946560.107688:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682eac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+26:11484:x1877943286572288:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1790946560.107723:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946560.107749:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeee00/0x16e41aef932727db lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cef1 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946560.107889:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef400/0x16e41aef932727e2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946560.107907:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef400/0x16e41aef932727e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946560.107920:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef400/0x16e41aef932727e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946560.107937:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef932727e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946560.107944:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef932727e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946560.107951:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef932727e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946560.108650:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef932727f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946560.108665:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef932727f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946560.108674:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef932727f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790946560.108689:0:5835:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1790946560.108812:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef400/0x16e41aef932727e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946560.108821:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef400/0x16e41aef932727e2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946560.108912:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef400/0x16e41aef932727e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946560.108922:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aef400 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:2.0:1790946560.108928:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef400/0x16e41aef932727e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946560.108937:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef400/0x16e41aef932727e2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946560.108951:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff914686750d00) 00010000:00010000:2.0:1790946560.108955:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790946560.108960:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef400/0x16e41aef932727e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946560.108967:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef400/0x16e41aef932727e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946560.108982:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef932727e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946560.108987:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef932727e9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946560.108992:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef932727e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946560.108996:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aef000 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:2.0:1790946560.108999:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef932727e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946560.109025:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef932727e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946560.109033:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9146a0a5ea00) 00010000:00010000:2.0:1790946560.109035:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790946560.109038:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef932727e9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946560.109043:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef932727e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946560.109099:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeee00/0x16e41aef932727db lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cef1 expref: 29 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946560.109115:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef932727f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cef1 expref: 28 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946560.109122:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff914686750200) 00010000:00010000:2.0:1790946560.109124:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790946560.109126:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914688aee400, rc 0) 00000100:00100000:2.0:1790946560.109403:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682eac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+28:11484:x1877943286572288:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 1715us (2013us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1790946560.109413:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 164 00000100:00100000:1.0:1790946560.117247:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946560.117310:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946560.117413:0:5821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286572544 00000100:00100000:3.0:1790946560.117427:0:5821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286572544 00000100:00100000:3.0:1790946560.117515:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:3.0:1790946560.117527:0:5821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146becb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+28:2363:x1877943286572544:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790946560.117549:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790946560.117583:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef932727f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cef1 expref: 28 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.117654:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff914686750200) 00010000:00010000:3.0:1790946560.117660:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790946560.117744:0:5821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146becb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+27:2363:x1877943286572544:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 218us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946560.117752:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:2.0:1790946560.118631:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286572416 00000100:00100000:2.0:1790946560.118644:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286572416 00000100:00100000:2.0:1790946560.118707:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 165 00000100:00100000:2.0:1790946560.118717:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146becb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+27:11484:x1877943286572416:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:2.0:1790946560.118817:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeee00/0x16e41aef932727fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946560.118986:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeee00/0x16e41aef932727fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946560.119002:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeee00/0x16e41aef932727fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946560.119038:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeee00/0x16e41aef932727fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946560.119047:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeee00/0x16e41aef932727fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946560.119055:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeee00/0x16e41aef932727fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946560.119061:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aeee00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:2.0:1790946560.119066:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeee00/0x16e41aef932727fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946560.119075:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeee00/0x16e41aef932727fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946560.119088:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff914686750200) 00010000:00010000:2.0:1790946560.119091:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790946560.119096:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeee00/0x16e41aef932727fe lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946560.119102:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeee00/0x16e41aef932727fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946560.119395:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146becb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+27:11484:x1877943286572416:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 677us (2204us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946560.119405:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 165 00000100:00100000:1.0:1790946560.124660:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946560.124750:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286572800 00000100:00100000:2.0:1790946560.124763:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286572800 00000100:00100000:2.0:1790946560.124835:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 47 00000100:00100000:2.0:1790946560.124855:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146becb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+27:11484:x1877943286572800:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:2.0:1790946560.125196:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146becb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+28:11484:x1877943286572800:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 341us (549us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1790946560.125625:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 47 00000100:00100000:1.0:1790946560.258145:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946560.258421:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286573056 00000100:00100000:2.0:1790946560.258436:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286573056 00000100:00100000:2.0:1790946560.258522:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 166 00000100:00100000:2.0:1790946560.258533:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146becb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+28:11502:x1877943286573056:12345-192.168.203.13@tcp:101:cat.0 00010000:00010000:2.0:1790946560.258570:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946560.258616:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeee00/0x16e41aef93272805 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cef8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946560.258759:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef9327280c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946560.258779:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef9327280c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946560.258792:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef9327280c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790946560.258830:0:5834:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1790946560.259361:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeee00/0x16e41aef93272805 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cef8 expref: 31 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946560.259388:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef9327280c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cef8 expref: 30 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946560.259397:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff914686750200) 00010000:00010000:2.0:1790946560.259400:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1790946560.259404:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914688aef000, rc 0) 00000100:00100000:2.0:1790946560.259507:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146becb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+30:11502:x1877943286573056:12345-192.168.203.13@tcp:101:cat.0 Request processed in 976us (1382us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1790946560.259516:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 166 00000100:00100000:3.0:1790946560.292895:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946560.293101:0:11315:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286573184 00000100:00100000:0.0:1790946560.293114:0:11315:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286573184 00000100:00100000:0.0:1790946560.293189:0:11315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 167 00000100:00100000:0.0:1790946560.293240:0:11315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914685635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+30:11503:x1877943286573184:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1790946560.293285:0:11315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946560.293312:0:11315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef9327281a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0ceff expref: -99 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946560.293406:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef93272821 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946560.293426:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef93272821 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946560.293440:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef93272821 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790946560.293486:0:11315:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1790946560.293491:0:11315:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790946560.293514:0:11315:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef93272821 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946560.293547:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef9327281a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ceff expref: 32 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946560.293571:0:11315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef93272821 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ceff expref: 31 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946560.293619:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff914686750d00) 00010000:00010000:0.0:1790946560.293623:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790946560.293628:0:11315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b1933a00, rc 0) 00000100:00100000:0.0:1790946560.293719:0:11315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914685635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+31:11503:x1877943286573184:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 520us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946560.293727:0:11315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 167 00010000:00010000:3.0:1790946560.304637:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946560.309467:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946560.309708:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286573568 00000100:00100000:2.0:1790946560.309722:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286573568 00000100:00100000:2.0:1790946560.309799:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 48 00000100:00100000:2.0:1790946560.309811:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be84a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+31:11503:x1877943286573568:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:2.0:1790946560.310323:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be84a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+32:11503:x1877943286573568:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 513us (871us total) trans 4294967457 rc 0/0 00000100:00100000:2.0:1790946560.310333:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 48 00000100:00100000:1.0:1790946560.315658:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946560.315877:0:5820:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286573696 00000100:00100000:0.0:1790946560.315890:0:5820:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286573696 00000100:00100000:0.0:1790946560.315977:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:0.0:1790946560.315990:0:5820:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beef3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+32:11503:x1877943286573696:12345-192.168.203.13@tcp:103:lfs.0 00010000:00010000:0.0:1790946560.316011:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1790946560.316047:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef932727b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cee3 expref: 32 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946560.316077:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef9327280c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cef8 expref: 31 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946560.316091:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cb600/0x16e41aef932726b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cea4 expref: 30 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946560.316105:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff914686750200) 00010000:00010000:0.0:1790946560.316118:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790946560.316197:0:5820:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beef3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+29:11503:x1877943286573696:12345-192.168.203.13@tcp:103:lfs.0 Request processed in 209us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946560.316299:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:3.0:1790946560.320908:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946560.321067:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286573824 00000100:00100000:2.0:1790946560.321081:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286573824 00000100:00100000:2.0:1790946560.321169:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 168 00000100:00100000:2.0:1790946560.321179:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914685636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+29:11503:x1877943286573824:12345-192.168.203.13@tcp:58:lfs.0 00010000:00010000:2.0:1790946560.321587:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeee00/0x16e41aef93272828 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946560.321636:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeee00/0x16e41aef93272828 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946560.321651:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeee00/0x16e41aef93272828 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790946560.324082:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1790946560.327064:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914685636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+29:11503:x1877943286573824:12345-192.168.203.13@tcp:58:lfs.0 Request processed in 5867us (6151us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946560.327085:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 168 00000100:00100000:1.0:1790946560.345708:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946560.346120:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286573952 00000100:00100000:2.0:1790946560.346133:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286573952 00000100:00100000:2.0:1790946560.346252:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 169 00000100:00100000:2.0:1790946560.346375:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beef1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+29:11505:x1877943286573952:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1790946560.346484:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946560.346516:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef9327282f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cf06 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.346623:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93272836 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.346642:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93272836 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.346658:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93272836 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.346677:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef9327283d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.346684:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef9327283d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.346691:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef9327283d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.347100:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef93272844 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.347110:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef93272844 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.347117:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef93272844 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790946560.347163:0:5834:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1790946560.347168:0:5834:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790946560.347192:0:5834:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef93272844 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.347241:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef93272844 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.347252:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93272836 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.347259:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93272836 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.347531:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93272836 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.347538:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146a032bc00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946560.347543:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93272836 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.347553:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93272836 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.347576:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff914686750d00) 00010000:00010000:3.0:1790946560.347579:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946560.347584:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93272836 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.347591:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93272836 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.347618:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef9327283d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.347624:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef9327283d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.347629:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef9327283d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.347635:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146a032ae00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946560.347638:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef9327283d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.347644:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef9327283d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.347652:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9146836df400) 00010000:00010000:3.0:1790946560.347654:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946560.347657:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef9327283d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.347662:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef9327283d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.347715:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef9327282f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf06 expref: 31 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.347730:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef93272844 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf06 expref: 30 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.347738:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9146a0a5ea00) 00010000:00010000:3.0:1790946560.347741:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790946560.347744:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146a032a400, rc 0) 00000100:00100000:3.0:1790946560.347984:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beef1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+30:11505:x1877943286573952:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 1721us (2290us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946560.347994:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 169 00000040:00080000:0.0:1790946560.880535:0:11687:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790946560.880545:0:11687:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790946560.881078:0:11687:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1790946560.881086:0:11687:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790946560.881275:0:11687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be84b100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11687:1877943303351040:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790946560.881419:0:11687:0:(client.c:2716:ptlrpc_set_wait()) set ffff914698bef9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790946560.885012:0:11687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be84b100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11687:1877943303351040:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790946560.885505:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946560.885545:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286574080 00000100:00100000:3.0:1790946560.885556:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286574080 00000100:00100000:3.0:1790946560.885650:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 170 00000100:00100000:3.0:1790946560.885662:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be077100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+30:11516:x1877943286574080:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790946560.885708:0:6803:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790946560.885843:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be077100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+30:11516:x1877943286574080:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 182us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946560.885851:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 170 00000100:00100000:2.0:1790946560.895847:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946560.895946:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286574208 00000100:00100000:3.0:1790946560.895960:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286574208 00000100:00100000:3.0:1790946560.896038:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 171 00000100:00100000:3.0:1790946560.896050:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914698016680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+30:11516:x1877943286574208:12345-192.168.203.13@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1790946560.896157:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef9327284b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.896195:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef9327284b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.896236:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef9327284b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.896268:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef93272852 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.896276:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef93272852 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.896284:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef93272852 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.896332:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93272859 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.896339:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93272859 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.896346:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93272859 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790946560.896393:0:5836:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1790946560.896398:0:5836:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790946560.896416:0:5836:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93272859 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.896429:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef9327284b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.896447:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef9327284b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.896455:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef9327284b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.896462:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146a032b400 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946560.896467:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef9327284b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.896477:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef9327284b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.896492:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9146a0a5e900) 00010000:00010000:3.0:1790946560.896495:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946560.896501:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef9327284b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.896507:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef9327284b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.896522:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef93272852 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.896528:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef93272852 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.896534:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef93272852 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.896539:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146a032ae00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946560.896549:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef93272852 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.896556:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef93272852 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.896565:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9146836df400) 00010000:00010000:3.0:1790946560.896568:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946560.896571:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef93272852 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.896578:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef93272852 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.896604:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93272859 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.896611:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93272859 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.896617:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93272859 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.896622:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146a032bc00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946560.896626:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93272859 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.896632:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93272859 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.896640:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9146a0a5ea00) 00010000:00010000:3.0:1790946560.896642:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946560.896652:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93272859 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.896658:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93272859 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946560.896769:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914698016680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+30:11516:x1877943286574208:12345-192.168.203.13@tcp:34:lhsmtool_posix.0 Request processed in 719us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946560.896778:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 171 00000100:00100000:3.0:1790946560.904344:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946560.904419:0:11315:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286574464 00000100:00100000:0.0:1790946560.904433:0:11315:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286574464 00000100:00100000:0.0:1790946560.904506:0:11315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 172 00000100:00100000:0.0:1790946560.904518:0:11315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914688711880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+30:11516:x1877943286574464:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790946560.904547:0:11315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946560.904602:0:11315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272860 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cf0d expref: -99 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946560.904736:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272867 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946560.904755:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272867 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946560.904767:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272867 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790946560.904780:0:11315:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1790946560.904908:0:11315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272867 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946560.904917:0:11315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272867 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946560.904941:0:11315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272867 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946560.904948:0:11315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1933800 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:0.0:1790946560.904954:0:11315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272867 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946560.904962:0:11315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272867 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946560.904977:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9146a0a5ea00) 00010000:00010000:0.0:1790946560.904980:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790946560.904985:0:11315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272867 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946560.904992:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272867 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946560.905047:0:11315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272860 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf0d expref: 32 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946560.905059:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9146a0a5e900) 00010000:00010000:0.0:1790946560.905061:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790946560.905065:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272860 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf0d expref: 32 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946560.905075:0:11315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b1932400, rc 0) 00000100:00100000:0.0:1790946560.905152:0:11315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914688711880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+31:11516:x1877943286574464:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 636us (823us total) trans 4294967458 rc 301/301 00000100:00100000:0.0:1790946560.905169:0:11315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 172 00000100:00100000:2.0:1790946560.911232:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946560.911562:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286574592 00000100:00100000:3.0:1790946560.911577:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286574592 00000100:00100000:3.0:1790946560.911757:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 173 00000100:00100000:3.0:1790946560.911770:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b68ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+31:11516:x1877943286574592:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790946560.911818:0:6803:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790946560.911982:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b68ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+31:11516:x1877943286574592:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 214us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946560.911991:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 173 00000100:00100000:2.0:1790946560.921473:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946560.921759:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286574848 00000100:00100000:3.0:1790946560.921773:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286574848 00000100:00100000:3.0:1790946560.921844:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 174 00000100:00100000:3.0:1790946560.921856:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b68a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+31:11516:x1877943286574848:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790946560.921885:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946560.921889:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1790946560.921923:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef93272821 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ceff expref: 31 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.921946:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff914686750d00) 00010000:00010000:3.0:1790946560.921963:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790946560.921982:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93272875 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cf14 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790946560.922949:0:5834:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1790946560.923289:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef9327287c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.923308:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef9327287c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.923321:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef9327287c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.923399:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032bc00/0x16e41aef93272875 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf14 expref: 33 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.923417:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef9327287c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf14 expref: 32 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.923425:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9146836df400) 00010000:00010000:3.0:1790946560.923428:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790946560.923433:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146a032ae00, rc 0) 00000100:00100000:3.0:1790946560.923537:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b68a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+32:11516:x1877943286574848:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 1681us (2076us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1790946560.923547:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 174 00000100:00100000:3.0:1790946560.928860:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946560.929050:0:11315:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286575104 00000100:00100000:1.0:1790946560.929064:0:11315:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286575104 00000100:00100000:1.0:1790946560.929198:0:11315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 175 00000100:00100000:1.0:1790946560.929231:0:11315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+32:11516:x1877943286575104:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790946560.929322:0:11315:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790946560.929359:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ae00/0x16e41aef9327287c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf14 expref: 32 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946560.929380:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9146836df400) 00010000:00010000:1.0:1790946560.929392:0:11315:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790946560.929420:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef9327288a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946560.929434:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef9327288a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946560.929442:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef9327288a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946560.931182:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272891 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xc956bc59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946560.931232:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272891 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc956bc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946560.931248:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272891 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc956bc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946560.931484:0:11315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef9327288a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946560.931494:0:11315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef9327288a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946560.931501:0:11315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef9327288a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946560.931507:0:11315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180e600 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:1.0:1790946560.931513:0:11315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef9327288a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946560.931521:0:11315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef9327288a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946560.931536:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff914686750d00) 00010000:00010000:1.0:1790946560.931540:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790946560.931545:0:11315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef9327288a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946560.931552:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef9327288a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946560.931578:0:11315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272891 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc956bc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946560.931586:0:11315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272891 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc956bc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946560.931604:0:11315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272891 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc956bc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946560.931610:0:11315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180f800 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:1.0:1790946560.931614:0:11315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272891 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc956bc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946560.931620:0:11315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272891 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc956bc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946560.931628:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xc956bc59 (ffff91469e29d700) 00010000:00010000:1.0:1790946560.931630:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790946560.931632:0:11315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272891 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xc956bc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946560.931638:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272891 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xc956bc59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946560.931746:0:11315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+31:11516:x1877943286575104:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 2515us (2897us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790946560.931766:0:11315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 175 00000100:00100000:0.0:1790946560.938272:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946560.938404:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286575232 00000100:00100000:3.0:1790946560.938419:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286575232 00000100:00100000:3.0:1790946560.938506:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 176 00000100:00100000:3.0:1790946560.938517:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be84b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+31:11516:x1877943286575232:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790946560.938546:0:6803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946560.938578:0:6803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93272898 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cf1b expref: -99 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.938653:0:6803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7400/0x16e41aef9327289f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.938671:0:6803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7400/0x16e41aef9327289f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.938684:0:6803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7400/0x16e41aef9327289f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.938945:0:6803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b400/0x16e41aef93272898 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf1b expref: 33 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.938971:0:6803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7400/0x16e41aef9327289f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf1b expref: 32 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.938981:0:6803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9146836df000) 00010000:00010000:3.0:1790946560.938985:0:6803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790946560.938990:0:6803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146be9f7400, rc 0) 00000100:00100000:3.0:1790946560.939230:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be84b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+32:11516:x1877943286575232:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 713us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946560.939239:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 176 00000100:00100000:2.0:1790946560.943604:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946560.945626:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286575488 00000100:00100000:3.0:1790946560.945644:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286575488 00000100:00100000:3.0:1790946560.945998:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 177 00000100:00100000:3.0:1790946560.946011:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5fdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+32:11516:x1877943286575488:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790946560.946105:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6400/0x16e41aef932728a6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.946241:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6400/0x16e41aef932728a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.946332:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6400/0x16e41aef932728a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790946560.946727:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:3.0:1790946560.946739:0:5835:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 346018537933ns, next at 347018535090ns, rc = 0 00000004:00010000:3.0:1790946560.946822:0:5835:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000007f7d97a1 reply state 00000000ece2180a transno 4294967460 ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6400/0x16e41aef932728a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946560.946832:0:5835:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790946560.946940:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5fdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+34:11516:x1877943286575488:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 932us (3355us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1790946560.946949:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 177 00000100:00100000:3.0:1790946560.949530:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946560.949611:0:11315:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286575616 00000100:00100000:0.0:1790946560.949621:0:11315:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286575616 00000100:00100000:0.0:1790946560.949683:0:11315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 178 00000100:00100000:0.0:1790946560.949694:0:11315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+34:11516:x1877943286575616:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790946560.949721:0:11315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946560.949744:0:11315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef932728ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cf22 expref: -99 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946560.949750:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6400/0x16e41aef932728a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946560.950243:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6400/0x16e41aef932728a6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946560.950255:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6400/0x16e41aef932728a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946560.950268:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef932728ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf22 expref: 35 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946560.954466:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146be9f6400 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:0.0:1790946560.954481:0:11315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef932728ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf22 expref: 35 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946560.954484:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6400/0x16e41aef932728a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946560.954526:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6400/0x16e41aef932728a6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946560.954555:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9146836df000) 00010000:00010000:1.0:1790946560.954559:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790946560.954567:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6400/0x16e41aef932728a6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946560.954568:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9146836df000) 00010000:00010000:0.0:1790946560.954578:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790946560.954585:0:11315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b1933800, rc 0) 00010000:00010000:1.0:1790946560.954588:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6400/0x16e41aef932728a6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946560.954758:0:11315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+34:11516:x1877943286575616:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 5062us (5232us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946560.954769:0:11315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 178 00000100:00100000:0.0:1790946560.961637:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946560.961792:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286575744 00000100:00100000:3.0:1790946560.961803:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286575744 00000100:00100000:3.0:1790946560.961874:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 52 00000100:00100000:3.0:1790946560.961885:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468e93d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2361:x1877943286575744:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1790946560.961980:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790946560.962295:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468e93d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+7:2361:x1877943286575744:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 Request processed in 411us (666us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1790946560.962304:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 52 00000100:00100000:3.0:1790946560.973346:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946560.973546:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286576000 00000100:00100000:2.0:1790946560.973556:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286576000 00000100:00100000:2.0:1790946560.973623:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 49 00000100:00100000:2.0:1790946560.973634:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+34:11516:x1877943286576000:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790946560.973874:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+35:11516:x1877943286576000:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 243us (537us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1790946560.973883:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 49 00000100:00100000:1.0:1790946560.979445:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946560.979529:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286576256 00000100:00100000:3.0:1790946560.979544:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286576256 00000100:00100000:3.0:1790946560.979618:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 179 00000100:00100000:3.0:1790946560.979628:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be074a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+35:11516:x1877943286576256:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790946560.979736:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be074a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+35:11516:x1877943286576256:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 109us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946560.979743:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 179 00000100:00100000:0.0:1790946560.985003:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946560.985084:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286576384 00000100:00100000:3.0:1790946560.985103:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286576384 00000100:00100000:3.0:1790946560.985318:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 180 00000100:00100000:3.0:1790946560.985328:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468e93c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+35:11516:x1877943286576384:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790946560.985360:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946560.985385:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef932728b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cf29 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.985458:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6000/0x16e41aef932728bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.985474:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6000/0x16e41aef932728bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.985486:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6000/0x16e41aef932728bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790946560.985524:0:5836:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790946560.985546:0:5836:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6000/0x16e41aef932728bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.985611:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef932728b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf29 expref: 37 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.985627:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6000/0x16e41aef932728bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf29 expref: 36 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946560.985636:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9146836df000) 00010000:00010000:3.0:1790946560.985639:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1790946560.985643:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146be9f6000, rc 0) 00000100:00100000:3.0:1790946560.985716:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468e93c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+36:11516:x1877943286576384:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 389us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946560.985724:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 180 00000100:00100000:0.0:1790946560.998959:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946560.999703:0:12075:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286576512 00000100:00100000:3.0:1790946560.999722:0:12075:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286576512 00000100:00100000:3.0:1790946560.999812:0:12075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 53 00000100:00100000:3.0:1790946560.999826:0:12075:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be97aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+7:2364:x1877943286576512:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790946560.999853:0:12075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946560.999897:0:12075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f10daa2/0x16e41aef932728c2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cf30 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790946560.999934:0:12075:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abfad00, blocks: 0x1 00010000:00010000:3.0:1790946560.999960:0:12075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=346s v=(0 0) 00010000:00010000:3.0:1790946560.999966:0:12075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790946560.999978:0:12075:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f10daa2/0x16e41aef932728c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf30 expref: 8 pid: 12075 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946561.000039:0:12075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002f10daa2/0x16e41aef932728c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf30 expref: 8 pid: 12075 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946561.000056:0:12075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146be9f6800, rc 0) 00000100:00100000:3.0:1790946561.000154:0:12075:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be97aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+8:2364:x1877943286576512:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 329us (1203us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946561.000163:0:12075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 53 00000100:00100000:1.0:1790946561.008273:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946561.009158:0:11315:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286576768 00000100:00100000:2.0:1790946561.009169:0:11315:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286576768 00000100:00100000:1.0:1790946561.009618:0:11315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 181 00000100:00100000:1.0:1790946561.009630:0:11315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be076a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+36:11516:x1877943286576768:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1790946561.009748:0:11315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be076a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+36:11516:x1877943286576768:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 120us (1485us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946561.009755:0:11315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 181 00000100:00100000:0.0:1790946561.016080:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946561.016471:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286576896 00000100:00100000:3.0:1790946561.016483:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286576896 00000100:00100000:3.0:1790946561.016546:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 54 00000100:00100000:3.0:1790946561.016556:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+8:11516:x1877943286576896:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790946561.016577:0:6674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946561.016606:0:6674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002111b52d/0x16e41aef932728c9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cf37 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946561.016639:0:6674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002f10daa2/0x16e41aef932728c2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf30 expref: 9 pid: 12075 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946561.016649:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790946561.016654:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790946561.016660:0:6674:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002111b52d/0x16e41aef932728c9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf37 expref: 9 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946561.016692:0:6674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002f10daa2/0x16e41aef932728c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf30 expref: 9 pid: 12075 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946561.016714:0:6674:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002f10daa2/0x16e41aef932728c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf30 expref: 9 pid: 12075 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946561.016728:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee38700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6674:1877943303351168:192.168.203.13@tcp:104: 00000100:00100000:3.0:1790946561.016819:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146c1c9fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1790946561.022637:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946561.022805:0:5819:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286577024 00000100:00100000:0.0:1790946561.022815:0:5819:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286577024 00010000:00010000:0.0:1790946561.022854:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002f10daa2/0x16e41aef932728c2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf30 expref: 10 pid: 12075 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946561.022896:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 68 00000100:00100000:0.0:1790946561.022906:0:5819:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914685711c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+10:2363:x1877943286577024:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790946561.022930:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790946561.022952:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002f10daa2/0x16e41aef932728c2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf30 expref: 10 pid: 12075 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946561.022967:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002f10daa2/0x16e41aef932728c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf30 expref: 10 pid: 12075 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946561.022993:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946561.022997:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946561.023006:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002111b52d/0x16e41aef932728c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf37 expref: 10 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946561.023017:0:5819:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002111b52d/0x16e41aef932728c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf37 expref: 10 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946561.023052:0:5819:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002111b52d/0x16e41aef932728c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf37 expref: 10 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946561.023067:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cf8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5819:1877943303351296:192.168.203.13@tcp:105: 00000100:00100000:0.0:1790946561.023159:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set ffff914698bef480 going to sleep for 11 seconds 00010000:00010000:3.0:1790946561.023790:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f10daa2/0x16e41aef932728c2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf30 expref: 10 pid: 12075 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946561.023806:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee38700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6674:1877943303351168:192.168.203.13@tcp:104: 00010000:00010000:3.0:1790946561.023831:0:6674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002111b52d/0x16e41aef932728c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf37 expref: 9 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946561.023842:0:6674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146be9f6200, rc 0) 00000100:00100000:3.0:1790946561.023880:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+9:11516:x1877943286576896:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 7326us (7807us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946561.023887:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 54 00000100:00100000:0.0:1790946561.025485:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cf8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5819:1877943303351296:192.168.203.13@tcp:105: 00010000:00010000:0.0:1790946561.025507:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790946561.025558:0:5819:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914685711c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+8:2363:x1877943286577024:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 2653us (2928us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946561.025567:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 68 00000100:00100000:0.0:1790946561.028851:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946561.029473:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286577152 00000100:00100000:3.0:1790946561.029484:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286577152 00002000:00100000:3.0:1790946561.029533:0:6681:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9146c1cf8000 x1877943286577152/t0(0) o4->7eed1f4b-bd5b-4a70-8045-59db065b3dfc@192.168.203.13@tcp:502/0 lens 504/0 e 0 to 0 dl 1790946572 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790946561.029544:0:6681:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9146c1cf8000 with x1877943286577152 ext(0->8) 00002000:00010000:3.0:1790946561.029549:0:6681:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9146c1cf8000 00000100:00100000:3.0:1790946561.029697:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:3.0:1790946561.029718:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+8:2363:x1877943286577152:12345-192.168.203.13@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1790946561.030175:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+10:2363:x1877943286577152:12345-192.168.203.13@tcp:4:lhsmtool_posix.0 Request processed in 458us (1336us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1790946561.031871:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 5 00002000:00100000:3.0:1790946561.031888:0:6681:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9146c1cf8000 x1877943286577152/t4294967315(0) o4->7eed1f4b-bd5b-4a70-8045-59db065b3dfc@192.168.203.13@tcp:502/0 lens 504/448 e 0 to 0 dl 1790946572 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790946561.031900:0:6681:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9146c1cf8000 with x1877943286577152 ext(0->8) 00002000:00010000:3.0:1790946561.032214:0:6681:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9146c1cf8000 00000100:00100000:3.0:1790946561.033651:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946561.033724:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286577280 00000100:00100000:2.0:1790946561.033734:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286577280 00000100:00100000:2.0:1790946561.033787:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 182 00000100:00100000:2.0:1790946561.033796:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+36:11516:x1877943286577280:12345-192.168.203.13@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1790946561.151385:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+36:11516:x1877943286577280:12345-192.168.203.13@tcp:44:lhsmtool_posix.0 Request processed in 117580us (117732us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946561.151398:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 182 00000001:00080000:2.0:1790946561.151469:0:5857:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000001:00080000:2.0:1790946561.151489:0:5857:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967461 is committed 00000004:00080000:2.0:1790946561.151512:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:2.0:1790946561.152022:0:5857:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:3.0:1790946561.152059:0:5868:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1790946561.152069:0:5868:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1790946561.152268:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790946561.152286:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146befb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303351424:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1790946561.152342:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946561.152624:0:6808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303351424 00000100:00100000:3.0:1790946561.152633:0:6808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303351424 00000100:00100000:3.0:1790946561.152696:0:6808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790946561.152705:0:6808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be075880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1877943303351424:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1790946561.152865:0:6808:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1790946561.152869:0:6808:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1790946560 00002000:00010000:3.0:1790946561.152871:0:6808:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1790946561.152873:0:6808:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1790946560 -> 1790946560 00002000:00010000:3.0:1790946561.152875:0:6808:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1790946561.152925:0:6808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be075880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3303:x1877943303351424:12345-0@lo:2:osp-syn-1-0.0 Request processed in 221us (583us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1790946561.152947:0:6808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1790946561.153057:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1790946561.153086:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9146befb0380/2, rc 0, transno 4294967316 00000100:00100000:0.0:1790946561.153092:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146befb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303351424:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1790946561.159990:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946561.160061:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286577408 00000100:00100000:3.0:1790946561.160072:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286577408 00000100:00100000:3.0:1790946561.160132:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 56 00000100:00100000:3.0:1790946561.160141:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5fdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+10:2361:x1877943286577408:12345-192.168.203.13@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1790946561.208469:0:7645:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:2.0:1790946561.208484:0:7645:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:3.0:1790946561.208650:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5fdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+7:2361:x1877943286577408:12345-192.168.203.13@tcp:16:lhsmtool_posix.0 Request processed in 48505us (48664us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946561.208661:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 56 00000100:00100000:1.0:1790946561.212080:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946561.212145:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286577664 00000100:00100000:0.0:1790946561.212155:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286577664 00000100:00100000:0.0:1790946561.212237:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 183 00000100:00100000:0.0:1790946561.212247:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be074380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+18:11516:x1877943286577664:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790946561.212309:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790946561.212337:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6000/0x16e41aef932728bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf29 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946561.212357:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9146836df000) 00010000:00010000:0.0:1790946561.212362:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790946561.212395:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef932728d0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946561.212409:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef932728d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946561.212419:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef932728d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790946561.212703:0:5834:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000080c3d0e reply state 00000000c4ef5808 transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef932728d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946561.212713:0:5834:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790946561.212808:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be074380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+19:11516:x1877943286577664:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 561us (737us total) trans 4294967462 rc 0/0 00000100:00100000:0.0:1790946561.212815:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 183 00000100:00100000:2.0:1790946561.217434:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00010000:00010000:3.0:1790946561.217711:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef932728d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946561.217724:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef932728d0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946561.217732:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef932728d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946561.217738:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1933a00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946561.217742:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef932728d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946561.217749:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef932728d0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946561.217765:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9146836df000) 00010000:00010000:3.0:1790946561.217768:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946561.217773:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef932728d0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946561.217794:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef932728d0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946561.218359:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286577792 00000100:00100000:0.0:1790946561.218369:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286577792 00000100:00100000:0.0:1790946561.218429:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 57 00000100:00100000:0.0:1790946561.218439:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+7:2364:x1877943286577792:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1790946561.218701:0:6674:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1790946561.218704:0:6674:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1790946560 -> 1790946559 00002000:00010000:0.0:1790946561.218707:0:6674:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1790946558 00002000:00010000:0.0:1790946561.218709:0:6674:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1790946560 -> 1790946559 00002000:00010000:0.0:1790946561.218711:0:6674:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1790946561.218780:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+8:2364:x1877943286577792:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 Request processed in 341us (1354us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1790946561.218788:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 57 00000100:00100000:2.0:1790946561.222101:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946561.222165:0:11315:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286578048 00000100:00100000:3.0:1790946561.222174:0:11315:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286578048 00000100:00100000:3.0:1790946561.222245:0:11315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 184 00000100:00100000:3.0:1790946561.222254:0:11315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146875b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+18:11516:x1877943286578048:12345-192.168.203.13@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1790946561.222410:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef932728d7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946561.222427:0:11315:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7400/0x16e41aef9327289f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf1b expref: 18 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946561.222437:0:11315:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef932728d7 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946561.222466:0:11315:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7400/0x16e41aef9327289f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf1b expref: 18 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946561.222480:0:11315:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7400/0x16e41aef9327289f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf1b expref: 18 pid: 6803 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946561.222494:0:11315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee39500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11315:1877943303351552:192.168.203.13@tcp:104: 00000100:00100000:3.0:1790946561.222576:0:11315:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146c1c9f480 going to sleep for 11 seconds 00000100:00100000:1.0:1790946561.231880:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946561.232434:0:11315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee39500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11315:1877943303351552:192.168.203.13@tcp:104: 00010000:00010000:3.0:1790946561.232463:0:11315:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef932728d7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946561.232503:0:5821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286578176 00000100:00100000:3.0:1790946561.232509:0:5821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286578176 00010000:00010000:3.0:1790946561.232543:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7400/0x16e41aef9327289f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf1b expref: 19 pid: 6803 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946561.232580:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 69 00000100:00100000:3.0:1790946561.232774:0:5821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be075c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+19:2364:x1877943286578176:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790946561.232791:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790946561.232798:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7400/0x16e41aef9327289f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf1b expref: 19 pid: 6803 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946561.232811:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7400/0x16e41aef9327289f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf1b expref: 19 pid: 6803 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946561.232833:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7400/0x16e41aef9327289f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf1b expref: 19 pid: 6803 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946561.232848:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9146836df000) 00010000:00010000:3.0:1790946561.232852:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef932728d7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946561.232863:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef932728d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946561.232871:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef932728d7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946561.232891:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790946561.232942:0:5821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be075c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+18:2364:x1877943286578176:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 172us (1071us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946561.238929:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 69 00010000:00010000:3.0:1790946561.238981:0:11315:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef932728d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946561.238992:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef932728d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946561.239021:0:11315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef932728d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946561.239028:0:11315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef932728d7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946561.239036:0:11315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef932728d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946561.239043:0:11315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146be9f6800 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946561.239047:0:11315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef932728d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946561.239055:0:11315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef932728d7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946561.239071:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9146836df000) 00010000:00010000:3.0:1790946561.239075:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1790946561.239080:0:11315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef932728d7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946561.239086:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef932728d7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946561.239192:0:11315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146875b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+17:11516:x1877943286578048:12345-192.168.203.13@tcp:55:lhsmtool_posix.0 Request processed in 16937us (17097us total) trans 0 rc -22/-22 00000100:00100000:3.0:1790946561.241848:0:11315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 184 00000040:00080000:0.0:1790946561.243760:0:12520:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790946561.243767:0:12520:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790946561.243808:0:12520:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1790946561.243813:0:12520:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790946561.246986:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946561.247054:0:6808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286578304 00000100:00100000:3.0:1790946561.247064:0:6808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286578304 00000100:00100000:3.0:1790946561.247116:0:6808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 58 00000100:00100000:3.0:1790946561.247125:0:6808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bdccad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+8:2363:x1877943286578304:12345-192.168.203.13@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1790946561.247168:0:6808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003989db87/0x16e41aef932728de lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946561.247189:0:6808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002111b52d/0x16e41aef932728c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf37 expref: 8 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946561.247217:0:6808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790946561.247222:0:6808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790946561.247226:0:6808:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003989db87/0x16e41aef932728de lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946561.247272:0:6808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002111b52d/0x16e41aef932728c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf37 expref: 8 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946561.247285:0:6808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002111b52d/0x16e41aef932728c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf37 expref: 8 pid: 6674 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946561.247301:0:6808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee39500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6808:1877943303351680:192.168.203.13@tcp:104: 00000100:00100000:3.0:1790946561.247406:0:6808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146c1c9f480 going to sleep for 11 seconds 00000100:00100000:2.0:1790946561.252772:0:6808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee39500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6808:1877943303351680:192.168.203.13@tcp:104: 00010000:00010000:2.0:1790946561.252801:0:6808:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003989db87/0x16e41aef932728de lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946561.255324:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946561.255620:0:5819:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286578432 00000100:00100000:0.0:1790946561.255630:0:5819:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286578432 00010000:00010000:0.0:1790946561.255668:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002111b52d/0x16e41aef932728c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf37 expref: 9 pid: 6674 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946561.255726:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 70 00000100:00100000:0.0:1790946561.255736:0:5819:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+9:2363:x1877943286578432:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790946561.255752:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790946561.255776:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002111b52d/0x16e41aef932728c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf37 expref: 9 pid: 6674 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946561.255789:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002111b52d/0x16e41aef932728c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf37 expref: 9 pid: 6674 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946561.255811:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002111b52d/0x16e41aef932728c9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf37 expref: 9 pid: 6674 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946561.255826:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790946561.255830:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790946561.255836:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003989db87/0x16e41aef932728de lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946561.255847:0:5819:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003989db87/0x16e41aef932728de lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946561.255874:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790946561.255923:0:5819:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+8:2363:x1877943286578432:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 188us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946561.255930:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 70 00010000:00010000:0.0:1790946561.255961:0:6808:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003989db87/0x16e41aef932728de lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946561.255971:0:6808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003989db87/0x16e41aef932728de lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946561.255994:0:6808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003989db87/0x16e41aef932728de lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946561.256003:0:6808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003989db87/0x16e41aef932728de lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946561.256011:0:6808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003989db87/0x16e41aef932728de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946561.256019:0:6808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146be9f7e00 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:0.0:1790946561.256024:0:6808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003989db87/0x16e41aef932728de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946561.256034:0:6808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003989db87/0x16e41aef932728de lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946561.256046:0:6808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003989db87/0x16e41aef932728de lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946561.256055:0:6808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003989db87/0x16e41aef932728de lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946561.256108:0:6808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bdccad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+7:2363:x1877943286578304:12345-192.168.203.13@tcp:1:lhsmtool_posix.0 Request processed in 8983us (9132us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946561.256116:0:6808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 58 00000100:00100000:3.0:1790946561.266588:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946561.270050:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286578688 00000100:00100000:0.0:1790946561.270076:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286578688 00000100:00100000:0.0:1790946561.270195:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 185 00000100:00100000:0.0:1790946561.270225:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+17:11516:x1877943286578688:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1790946561.270569:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef932728e5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946561.270606:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef932728e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946561.270621:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef932728e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946561.270920:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef932728ec lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946561.270933:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef932728ad lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf22 expref: 18 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946561.270944:0:5835:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef932728ec lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946561.270992:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef932728ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf22 expref: 18 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946561.271033:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef932728ad lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf22 expref: 18 pid: 11315 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946561.271053:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146befb2300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5835:1877943303351808:192.168.203.13@tcp:104: 00000100:00100000:0.0:1790946561.271185:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff914687af9300 going to sleep for 11 seconds 00000100:00100000:2.0:1790946561.283137:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946561.283534:0:5821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286578816 00000100:00100000:3.0:1790946561.283543:0:5821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286578816 00010000:00010000:3.0:1790946561.283581:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef932728ad lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf22 expref: 19 pid: 11315 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946561.283639:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 71 00000100:00100000:3.0:1790946561.283648:0:5821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146875b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+19:2363:x1877943286578816:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790946561.283663:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790946561.283670:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef932728ad lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf22 expref: 19 pid: 11315 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946561.283683:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef932728ad lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf22 expref: 19 pid: 11315 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946561.283706:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9146836df000) 00010000:00010000:3.0:1790946561.283712:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef932728ec lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946561.283722:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef932728ec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946561.283731:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef932728ec lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946561.283747:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790946561.283798:0:5821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146875b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+19:2363:x1877943286578816:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 150us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946561.283814:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 71 00010000:00010000:0.0:1790946561.285821:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef932728ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf22 expref: 18 pid: 11315 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946561.285843:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146befb2300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5835:1877943303351808:192.168.203.13@tcp:104: 00010000:00010000:0.0:1790946561.285867:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef932728ec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946561.285876:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef932728ec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946561.285883:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef932728ec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790946561.286045:0:5835:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1790946561.286196:0:5835:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:0.0:1790946561.286258:0:5835:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:0.0:1790946561.286341:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146befb2300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5835:1877943303351936:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1790946561.286408:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946561.286443:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff914687af9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790946561.287435:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303351936 00000100:00100000:1.0:1790946561.287446:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303351936 00000100:00100000:1.0:1790946561.287500:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790946561.287509:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914698014a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5835:x1877943303351936:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1790946561.287620:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914698014a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5835:x1877943303351936:12345-0@lo:1000:mdt00_001.0 Request processed in 111us (1211us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946561.287627:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790946561.287637:0:5835:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:0.0:1790946561.287643:0:5835:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9146befb0380, transno 4294967316 00000100:00100000:0.0:1790946561.287659:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146befb2300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5835:1877943303351936:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1790946561.288178:0:5835:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:0.0:1790946561.291050:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146befb0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5835:1877943303352064:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1790946561.291116:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946561.291142:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff914684855840 going to sleep for 11 seconds 00000100:00100000:1.0:1790946561.291287:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303352064 00000100:00100000:1.0:1790946561.291294:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303352064 00000100:00100000:1.0:1790946561.291332:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790946561.291340:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146befb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5835:x1877943303352064:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1790946561.291607:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146befb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5835:x1877943303352064:12345-0@lo:1000:mdt00_001.0 Request processed in 266us (490us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1790946561.291614:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790946561.292073:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146befb0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5835:1877943303352064:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1790946561.292112:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef932728ec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946561.292123:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef932728ec lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946561.292132:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef932728ec lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946561.292138:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1933a00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946561.292143:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef932728ec lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946561.292151:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef932728ec lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946561.292166:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9146836df000) 00010000:00010000:3.0:1790946561.292169:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790946561.292173:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef932728ec lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946561.292180:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef932728ec lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946561.292243:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeee00/0x16e41aef93272828 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946561.292250:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeee00/0x16e41aef93272828 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946561.292329:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeee00/0x16e41aef93272828 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946561.292335:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aeee00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946561.292338:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeee00/0x16e41aef93272828 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946561.292344:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeee00/0x16e41aef93272828 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946561.292353:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9146a0a5ea00) 00010000:00010000:3.0:1790946561.292356:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790946561.292359:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeee00/0x16e41aef93272828 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946561.292365:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeee00/0x16e41aef93272828 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946561.292385:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7400/0x16e41aef932728f3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946561.292400:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef93272844 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf06 expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946561.292409:0:5835:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7400/0x16e41aef932728f3 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946561.292440:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef93272844 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf06 expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946561.292456:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef93272844 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf06 expref: 21 pid: 5834 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946561.292474:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146beee4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5835:1877943303352192:192.168.203.13@tcp:104: 00000100:00100000:3.0:1790946561.292546:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146c1c9f540 going to sleep for 11 seconds 00000100:00100000:3.0:1790946561.296434:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146beee4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5835:1877943303352192:192.168.203.13@tcp:104: 00010000:00010000:3.0:1790946561.296461:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7400/0x16e41aef932728f3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946561.297712:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946561.297928:0:5820:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286578944 00000100:00100000:2.0:1790946561.297936:0:5820:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286578944 00010000:00010000:2.0:1790946561.297973:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef93272844 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf06 expref: 22 pid: 5834 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946561.298012:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 72 00000100:00100000:2.0:1790946561.298022:0:5820:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beee4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+22:2363:x1877943286578944:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790946561.298044:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790946561.298051:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef93272844 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf06 expref: 22 pid: 5834 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946561.298064:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef93272844 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf06 expref: 22 pid: 5834 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946561.298084:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a400/0x16e41aef93272844 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf06 expref: 22 pid: 5834 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946561.298101:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9146a0a5ea00) 00010000:00010000:2.0:1790946561.298106:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7400/0x16e41aef932728f3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946561.298116:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7400/0x16e41aef932728f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946561.298123:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7400/0x16e41aef932728f3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946561.298150:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790946561.298219:0:5820:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beee4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+21:2363:x1877943286578944:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 197us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946561.298227:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 72 00010000:00010000:2.0:1790946561.298329:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7400/0x16e41aef932728f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946561.298337:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7400/0x16e41aef932728f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946561.298363:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7400/0x16e41aef932728f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946561.298369:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7400/0x16e41aef932728f3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946561.298376:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7400/0x16e41aef932728f3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946561.298382:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146be9f7400 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:2.0:1790946561.298386:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7400/0x16e41aef932728f3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946561.298393:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7400/0x16e41aef932728f3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946561.298401:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9146a0a5ea00) 00010000:00010000:2.0:1790946561.298404:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790946561.298407:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7400/0x16e41aef932728f3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946561.298412:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7400/0x16e41aef932728f3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946561.298422:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef932728e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946561.298427:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef932728e5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946561.298433:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef932728e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946561.298443:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1932800 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:2.0:1790946561.298446:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef932728e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946561.298451:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef932728e5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946561.298459:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9146a0a5ea00) 00010000:00010000:2.0:1790946561.298461:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790946561.298464:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef932728e5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946561.298470:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef932728e5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946561.298904:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+20:11516:x1877943286578688:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 28680us (32324us total) trans 4294967467 rc 0/0 00000100:00100000:2.0:1790946561.298912:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 185 00000020:00080000:2.0:1790946561.298916:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1790946561.299296:0:11687:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790946561.299301:0:11687:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790946561.299802:0:11687:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1790946561.299810:0:11687:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790946561.309029:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946561.309101:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286579200 00000100:00100000:1.0:1790946561.309111:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286579200 00000100:00100000:1.0:1790946561.309163:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 50 00000100:00100000:1.0:1790946561.309173:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b2652850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+20:11516:x1877943286579200:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1790946561.309817:0:5837:0:(mdd_object.c:4180:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1790946561.309924:0:5837:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967468 00010000:00010000:1.0:1790946561.309975:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef932728fa lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946561.309992:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef932728fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946561.310004:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef932728fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946561.310013:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef932728fa lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946561.310019:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef932728fa lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946561.310026:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef932728fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946561.312467:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1790946561.312608:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b2652850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+22:11516:x1877943286579200:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 3420us (3573us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1790946561.312618:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 50 00000020:00080000:1.0:1790946561.312624:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790946561.312845:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790946561.312854:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef932728fa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946561.312864:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180f600 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:3.0:1790946561.312868:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef932728fa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946561.312877:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef932728fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946561.312894:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91469e29d500) 00010000:00010000:3.0:1790946561.312897:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1790946561.312901:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef932728fa lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946561.312920:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef932728fa lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946561.312938:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946561.312939:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946561.312941:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946561.335681:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946561.520757:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146beee7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303352320:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790946561.520841:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946561.521180:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303352320 00000100:00100000:3.0:1790946561.521190:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303352320 00000100:00080000:0.0:1790946561.521335:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790946561.521385:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1790946561.521397:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146befb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1877943303352320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790946561.521435:0:6678:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790946561.521497:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146befb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1877943303352320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946561.521505:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1790946561.524048:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146beee7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303352320:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790946562.352778:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790946563.024752:0:12572:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790946563.024763:0:12572:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790946563.024799:0:12572:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1790946563.024805:0:12572:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790946563.192481:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946563.196713:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286579456 00000100:00100000:3.0:1790946563.196789:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286579456 00000100:00100000:3.0:1790946563.196926:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 186 00000100:00100000:3.0:1790946563.196936:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bdccb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+22:11534:x1877943286579456:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1790946563.196960:0:6803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946563.196981:0:6803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef93272901 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cf3e expref: -99 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.197143:0:6803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7c00/0x16e41aef93272908 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.197157:0:6803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7c00/0x16e41aef93272908 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.197178:0:6803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7c00/0x16e41aef93272908 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790946563.197190:0:6803:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1790946563.197402:0:6803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef93272901 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf3e expref: 25 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.197418:0:6803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7c00/0x16e41aef93272908 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf3e expref: 24 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.197426:0:6803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff914686750d00) 00010000:00010000:3.0:1790946563.197430:0:6803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790946563.197433:0:6803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146be9f7c00, rc 0) 00000100:00100000:3.0:1790946563.197499:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bdccb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+24:11534:x1877943286579456:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 564us (5025us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1790946563.197507:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 186 00000100:00080000:1.0:1790946563.197792:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790946563.205357:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946563.205421:0:11315:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286579584 00000100:00100000:1.0:1790946563.205430:0:11315:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286579584 00000100:00100000:1.0:1790946563.205483:0:11315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 187 00000100:00100000:1.0:1790946563.205503:0:11315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146875b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+24:11534:x1877943286579584:12345-192.168.203.13@tcp:34:lfs.0 00010000:00010000:1.0:1790946563.205590:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef93272916 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.205607:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef93272916 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.205619:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef93272916 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.205635:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef9327291d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.205643:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef9327291d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.205650:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef9327291d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.205872:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272924 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.205882:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272924 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.205889:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272924 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790946563.205927:0:11315:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272924 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.205939:0:11315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef93272916 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.205952:0:11315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef93272916 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.205959:0:11315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef93272916 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.205965:0:11315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180fa00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:1.0:1790946563.205969:0:11315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef93272916 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.205978:0:11315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef93272916 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.205989:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff914686750d00) 00010000:00010000:1.0:1790946563.205992:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790946563.205997:0:11315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef93272916 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.206003:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef93272916 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.206013:0:11315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef9327291d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.206019:0:11315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef9327291d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.206024:0:11315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef9327291d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.206028:0:11315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180e600 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:1.0:1790946563.206036:0:11315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef9327291d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.206043:0:11315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef9327291d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.206050:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91469e29df00) 00010000:00010000:1.0:1790946563.206052:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790946563.206055:0:11315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef9327291d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.206061:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef9327291d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.206075:0:11315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272924 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.206082:0:11315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272924 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.206088:0:11315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272924 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.206094:0:11315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180f800 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:1.0:1790946563.206097:0:11315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272924 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.206103:0:11315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272924 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.206110:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91469e29dd00) 00010000:00010000:1.0:1790946563.206112:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790946563.206121:0:11315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272924 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.206128:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272924 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946563.206225:0:11315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146875b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+24:11534:x1877943286579584:12345-192.168.203.13@tcp:34:lfs.0 Request processed in 701us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946563.206233:0:11315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 187 00000100:00100000:2.0:1790946563.265106:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946563.265498:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286579840 00000100:00100000:3.0:1790946563.265508:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286579840 00000100:00100000:3.0:1790946563.265569:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 188 00000100:00100000:3.0:1790946563.265591:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146875b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+24:11537:x1877943286579840:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1790946563.265611:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946563.265630:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6e00/0x16e41aef9327292b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cf45 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.265706:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef93272932 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.265737:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef93272932 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.265748:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef93272932 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.265762:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6c00/0x16e41aef93272939 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.265769:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6c00/0x16e41aef93272939 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.265776:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6c00/0x16e41aef93272939 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.266077:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6600/0x16e41aef93272940 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.266086:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6600/0x16e41aef93272940 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.266093:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6600/0x16e41aef93272940 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790946563.266103:0:5835:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1790946563.266189:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef93272932 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.266197:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef93272932 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.266702:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef93272932 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.266717:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146be9f6800 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946563.266722:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef93272932 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.266730:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef93272932 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.266743:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff914686750d00) 00010000:00010000:3.0:1790946563.266746:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946563.266750:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef93272932 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.266756:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef93272932 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.266769:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6c00/0x16e41aef93272939 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.266775:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6c00/0x16e41aef93272939 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.266780:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6c00/0x16e41aef93272939 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.266785:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146be9f6c00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946563.266788:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6c00/0x16e41aef93272939 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.266795:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6c00/0x16e41aef93272939 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.266812:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9146836df000) 00010000:00010000:3.0:1790946563.266815:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946563.266818:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6c00/0x16e41aef93272939 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.266824:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6c00/0x16e41aef93272939 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.266926:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6e00/0x16e41aef9327292b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf45 expref: 27 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.266941:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6600/0x16e41aef93272940 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf45 expref: 26 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.266949:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9146836df300) 00010000:00010000:3.0:1790946563.266951:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790946563.266954:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146be9f6600, rc 0) 00000100:00100000:3.0:1790946563.267768:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146875b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+26:11537:x1877943286579840:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 2187us (2670us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1790946563.267784:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 188 00000100:00100000:3.0:1790946563.273998:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946563.274092:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286579968 00000100:00100000:1.0:1790946563.274102:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286579968 00000100:00100000:1.0:1790946563.274158:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 189 00000100:00100000:1.0:1790946563.274167:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beee5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+26:11537:x1877943286579968:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:1.0:1790946563.274335:0:6803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef9327294e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.274353:0:6803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef9327294e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.274364:0:6803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef9327294e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.274390:0:6803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef9327294e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.274398:0:6803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef9327294e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.274405:0:6803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef9327294e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.274411:0:6803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180f800 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:1.0:1790946563.274428:0:6803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef9327294e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.274437:0:6803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef9327294e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.274449:0:6803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9146836df300) 00010000:00010000:1.0:1790946563.274452:0:6803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790946563.274456:0:6803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef9327294e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.274462:0:6803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef9327294e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946563.274531:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beee5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+26:11537:x1877943286579968:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 365us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946563.274538:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 189 00000100:00100000:0.0:1790946563.278751:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946563.278892:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286580224 00000100:00100000:2.0:1790946563.278902:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286580224 00000100:00100000:2.0:1790946563.278951:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 51 00000100:00100000:2.0:1790946563.278959:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146becb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+26:11537:x1877943286580224:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:2.0:1790946563.279234:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146becb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+27:11537:x1877943286580224:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 274us (489us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1790946563.279262:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 51 00000100:00100000:0.0:1790946563.332716:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946563.332817:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286580480 00000100:00100000:2.0:1790946563.332895:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286580480 00000100:00100000:2.0:1790946563.332953:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 190 00000100:00100000:2.0:1790946563.332963:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146becb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+27:11063:x1877943286580480:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:2.0:1790946563.332989:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946563.333009:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93272955 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cf4c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946563.333105:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef9327295c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946563.333120:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6600/0x16e41aef93272940 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf45 expref: 28 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946563.333130:0:5834:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef9327295c lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946563.333165:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6600/0x16e41aef93272940 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf45 expref: 28 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946563.333179:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6600/0x16e41aef93272940 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf45 expref: 28 pid: 5835 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946563.333193:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be0c6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5834:1877943303352448:192.168.203.13@tcp:104: 00000100:00100000:3.0:1790946563.333502:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff914682b45b40 going to sleep for 11 seconds 00000100:00100000:1.0:1790946563.336483:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946563.336730:0:5819:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286580608 00000100:00100000:0.0:1790946563.336740:0:5819:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286580608 00010000:00010000:0.0:1790946563.336778:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6600/0x16e41aef93272940 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf45 expref: 29 pid: 5835 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946563.336820:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 73 00000100:00100000:0.0:1790946563.336829:0:5819:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bdcc8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+29:2363:x1877943286580608:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790946563.336843:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790946563.336850:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6600/0x16e41aef93272940 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf45 expref: 29 pid: 5835 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946563.336863:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6600/0x16e41aef93272940 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf45 expref: 29 pid: 5835 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946563.336884:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9146836df300) 00010000:00010000:0.0:1790946563.336889:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef9327295c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946563.336915:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef9327295c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946563.336923:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef9327295c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946563.336941:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790946563.336999:0:5819:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bdcc8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+29:2363:x1877943286580608:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 171us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946563.337008:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 73 00010000:00010000:3.0:1790946563.337691:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6600/0x16e41aef93272940 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf45 expref: 28 pid: 5835 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946563.337709:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be0c6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5834:1877943303352448:192.168.203.13@tcp:104: 00010000:00010000:3.0:1790946563.337729:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef9327295c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.337745:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef9327295c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.337752:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef9327295c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790946563.337770:0:5834:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1790946563.337909:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93272955 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf4c expref: 29 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.337925:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef9327295c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf4c expref: 28 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.337933:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9146836df300) 00010000:00010000:3.0:1790946563.337936:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790946563.337938:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914688aef200, rc 0) 00000100:00100000:3.0:1790946563.338029:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146becb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+28:11063:x1877943286580480:12345-192.168.203.13@tcp:101:bash.0 Request processed in 5067us (5322us total) trans 4294967473 rc 0/0 00000100:00100000:3.0:1790946563.338037:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 190 00000100:00100000:1.0:1790946563.342551:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946563.342631:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286580864 00000100:00100000:3.0:1790946563.342641:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286580864 00000100:00100000:3.0:1790946563.342694:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 191 00000100:00100000:3.0:1790946563.342703:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bdccaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+28:11063:x1877943286580864:12345-192.168.203.13@tcp:36:bash.0 00010000:00010000:3.0:1790946563.342952:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6e00/0x16e41aef9327296a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.342970:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6e00/0x16e41aef9327296a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.342998:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6e00/0x16e41aef9327296a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790946563.343054:0:5835:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967474 00000004:00010000:3.0:1790946563.343078:0:5835:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000c0af4b31 reply state 00000000495f763f transno 4294967475 ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6e00/0x16e41aef9327296a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946563.343088:0:5835:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1790946563.343161:0:5835:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967475 00000100:00100000:3.0:1790946563.343299:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bdccaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+32:11063:x1877943286580864:12345-192.168.203.13@tcp:36:bash.0 Request processed in 596us (758us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1790946563.343307:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 191 00000020:00080000:3.0:1790946563.343312:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1790946563.350783:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6e00/0x16e41aef9327296a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.350800:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6e00/0x16e41aef9327296a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.350808:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6e00/0x16e41aef9327296a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.350814:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146be9f6e00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:1.0:1790946563.350820:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6e00/0x16e41aef9327296a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.350847:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6e00/0x16e41aef9327296a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.350863:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9146836df300) 00010000:00010000:1.0:1790946563.350866:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790946563.350871:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6e00/0x16e41aef9327296a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.350878:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6e00/0x16e41aef9327296a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946563.351395:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946563.351529:0:11315:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286580992 00000100:00100000:3.0:1790946563.351539:0:11315:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286580992 00000100:00100000:3.0:1790946563.351603:0:11315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 192 00000100:00100000:3.0:1790946563.351613:0:11315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bdcc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+31:11063:x1877943286580992:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:3.0:1790946563.351638:0:11315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946563.351655:0:11315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6600/0x16e41aef93272971 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cf53 expref: -99 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.351708:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6600/0x16e41aef93272971 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf53 expref: 32 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.351721:0:11315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6600/0x16e41aef93272971 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf53 expref: 32 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.351738:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9146836df300) 00010000:00010000:3.0:1790946563.351747:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790946563.351751:0:11315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146be9f6600, rc 0) 00000100:00100000:3.0:1790946563.351805:0:11315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bdcc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+32:11063:x1877943286580992:12345-192.168.203.13@tcp:101:bash.0 Request processed in 194us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946563.351812:0:11315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 192 00000100:00100000:0.0:1790946563.359395:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946563.359479:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286581120 00000100:00100000:3.0:1790946563.359489:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286581120 00000100:00100000:3.0:1790946563.359562:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 59 00000100:00100000:3.0:1790946563.359572:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146becb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+7:11063:x1877943286581120:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:3.0:1790946563.359599:0:6673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946563.359620:0:6673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000def4f4a/0x16e41aef93272978 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cf5a expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790946563.359647:0:6673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6abfacff, atime: 0x6abfacfe, ctime: 0x6abfacff, blocks: 0xb 00010000:00010000:3.0:1790946563.359669:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=348s v=(0 0) 00010000:00010000:3.0:1790946563.359674:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790946563.359681:0:6673:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000def4f4a/0x16e41aef93272978 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf5a expref: 8 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.359698:0:6673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000def4f4a/0x16e41aef93272978 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf5a expref: 8 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.359711:0:6673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146be9f6c00, rc 0) 00000100:00100000:3.0:1790946563.359778:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146becb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+8:11063:x1877943286581120:12345-192.168.203.13@tcp:101:bash.0 Request processed in 207us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946563.359785:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 59 00000100:00080000:1.0:1790946563.360107:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790946563.368468:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946563.368642:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286581248 00000100:00100000:1.0:1790946563.368652:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286581248 00002000:00010000:1.0:1790946563.368691:0:6680:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:1.0:1790946563.368695:0:6680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9146beef3b80 with x1877943286581248 ext(0->18446744073709551615) 00002000:00010000:1.0:1790946563.368706:0:6680:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9146beef3b80. 00000100:00100000:1.0:1790946563.368742:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:1.0:1790946563.368752:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beef3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+8:2362:x1877943286581248:12345-192.168.203.13@tcp:10:bash.0 00002000:00010000:1.0:1790946563.368997:0:6680:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1790946563.369001:0:6680:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1790946559 -> 1790946562 00002000:00010000:1.0:1790946563.369004:0:6680:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1790946558 -> 1790946558 00002000:00010000:1.0:1790946563.369006:0:6680:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1790946559 -> 1790946562 00002000:00010000:1.0:1790946563.369008:0:6680:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1790946563.369172:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beef3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+9:2362:x1877943286581248:12345-192.168.203.13@tcp:10:bash.0 Request processed in 420us (714us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1790946563.369195:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 6 00002000:00010000:1.0:1790946563.369231:0:6680:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:1.0:1790946563.369235:0:6680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9146beef3b80 with x1877943286581248 ext(0->18446744073709551615) 00002000:00010000:1.0:1790946563.369240:0:6680:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9146beef3b80. 00010000:00010000:3.0:1790946563.376896:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946563.449150:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946563.449445:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286581376 00000100:00100000:3.0:1790946563.449458:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286581376 00000100:00100000:3.0:1790946563.449556:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 193 00000100:00100000:3.0:1790946563.449566:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be0c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+32:11551:x1877943286581376:12345-192.168.203.13@tcp:34:lfs.0 00010000:00010000:3.0:1790946563.449652:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef9327297f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.449670:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef9327297f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.449681:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef9327297f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.449698:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6a00/0x16e41aef93272986 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.449706:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6a00/0x16e41aef93272986 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.449713:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6a00/0x16e41aef93272986 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.449926:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7200/0x16e41aef9327298d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.449935:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7200/0x16e41aef9327298d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.449943:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7200/0x16e41aef9327298d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790946563.449983:0:5834:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7200/0x16e41aef9327298d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.450004:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef9327297f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.450011:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef9327297f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.450018:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef9327297f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.450025:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146be9f6800 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946563.450030:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef9327297f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.450037:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef9327297f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.450048:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff914686750d00) 00010000:00010000:3.0:1790946563.450051:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946563.450056:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef9327297f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.450063:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef9327297f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.450075:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6a00/0x16e41aef93272986 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.450081:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6a00/0x16e41aef93272986 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.450088:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6a00/0x16e41aef93272986 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.450099:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146be9f6a00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946563.450103:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6a00/0x16e41aef93272986 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.450123:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6a00/0x16e41aef93272986 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.450132:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9146836df900) 00010000:00010000:3.0:1790946563.450134:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946563.450137:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6a00/0x16e41aef93272986 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.450144:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6a00/0x16e41aef93272986 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.450159:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7200/0x16e41aef9327298d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.450166:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7200/0x16e41aef9327298d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.450172:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7200/0x16e41aef9327298d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.450177:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146be9f7200 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946563.450179:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7200/0x16e41aef9327298d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.450184:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7200/0x16e41aef9327298d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.451883:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9146836df300) 00010000:00010000:3.0:1790946563.451891:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946563.451898:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7200/0x16e41aef9327298d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.451907:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7200/0x16e41aef9327298d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946563.452009:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be0c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+32:11551:x1877943286581376:12345-192.168.203.13@tcp:34:lfs.0 Request processed in 2439us (2863us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946563.452018:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 193 00000100:00100000:2.0:1790946563.519803:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946563.519975:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286581632 00000100:00100000:1.0:1790946563.519986:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286581632 00000100:00100000:1.0:1790946563.520044:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 194 00000100:00100000:1.0:1790946563.520053:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be0c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+32:11554:x1877943286581632:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1790946563.520072:0:6803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946563.520093:0:6803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272994 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cf61 expref: -99 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.520175:0:6803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327299b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.520190:0:6803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327299b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.520231:0:6803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327299b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.520257:0:6803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef932729a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.520265:0:6803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef932729a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.520272:0:6803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef932729a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.520561:0:6803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef932729a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.520571:0:6803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef932729a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.520590:0:6803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef932729a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790946563.520601:0:6803:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1790946563.520690:0:6803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327299b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.520699:0:6803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327299b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.520707:0:6803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327299b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.520713:0:6803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180fa00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:1.0:1790946563.520718:0:6803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327299b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.520727:0:6803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327299b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.520739:0:6803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff914686750d00) 00010000:00010000:1.0:1790946563.520742:0:6803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790946563.520746:0:6803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327299b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.520762:0:6803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef9327299b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.520776:0:6803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef932729a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.520782:0:6803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef932729a2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.520789:0:6803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef932729a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.520925:0:6803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180f800 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:1.0:1790946563.520929:0:6803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef932729a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.520936:0:6803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef932729a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.520944:0:6803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91469e29dd00) 00010000:00010000:1.0:1790946563.520947:0:6803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790946563.520950:0:6803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef932729a2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.520956:0:6803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef932729a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.520998:0:6803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272994 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf61 expref: 35 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.521014:0:6803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef932729a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf61 expref: 34 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.521028:0:6803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9146836df300) 00010000:00010000:1.0:1790946563.521031:0:6803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1790946563.521034:0:6803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b180fc00, rc 0) 00000100:00100000:1.0:1790946563.521099:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be0c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+34:11554:x1877943286581632:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 1047us (1324us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1790946563.521107:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 194 00000100:00100000:0.0:1790946563.532470:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946563.532712:0:11315:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286581760 00000100:00100000:3.0:1790946563.532722:0:11315:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286581760 00000100:00100000:3.0:1790946563.532778:0:11315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 195 00000100:00100000:3.0:1790946563.532797:0:11315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b631bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+34:11554:x1877943286581760:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:3.0:1790946563.532867:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7200/0x16e41aef932729b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.532884:0:11315:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef9327295c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf4c expref: 34 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.532894:0:11315:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7200/0x16e41aef932729b7 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.532925:0:11315:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef9327295c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf4c expref: 34 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.532939:0:11315:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef9327295c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf4c expref: 34 pid: 5834 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946563.532967:0:11315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146beee4380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11315:1877943303352576:192.168.203.13@tcp:104: 00000100:00100000:3.0:1790946563.533064:0:11315:0:(client.c:2716:ptlrpc_set_wait()) set ffff914681377300 going to sleep for 11 seconds 00000100:00100000:2.0:1790946563.537778:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946563.537909:0:11315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146beee4380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11315:1877943303352576:192.168.203.13@tcp:104: 00010000:00010000:3.0:1790946563.537935:0:11315:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7200/0x16e41aef932729b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946563.538010:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286582016 00000100:00100000:1.0:1790946563.538017:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286582016 00000100:00100000:1.0:1790946563.538070:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 52 00000100:00100000:1.0:1790946563.538080:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91469829f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+35:5599:x1877943286582016:12345-192.168.203.13@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1790946563.538424:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91469829f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+36:5599:x1877943286582016:12345-192.168.203.13@tcp:35:ldlm_bl.0 Request processed in 344us (656us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1790946563.538433:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 52 00000100:00100000:0.0:1790946563.544360:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946563.544443:0:5821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286582144 00000100:00100000:3.0:1790946563.544453:0:5821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286582144 00010000:00010000:3.0:1790946563.544493:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef9327295c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf4c expref: 36 pid: 5834 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946563.544532:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 74 00000100:00100000:3.0:1790946563.544541:0:5821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b6319180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+36:2364:x1877943286582144:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790946563.544555:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790946563.544561:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef9327295c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf4c expref: 36 pid: 5834 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.544589:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef9327295c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf4c expref: 36 pid: 5834 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.544613:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef9327295c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf4c expref: 36 pid: 5834 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.544632:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9146836df300) 00010000:00010000:3.0:1790946563.544637:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7200/0x16e41aef932729b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.544662:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7200/0x16e41aef932729b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.544670:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7200/0x16e41aef932729b7 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.544703:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790946563.544758:0:5821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b6319180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+35:2364:x1877943286582144:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 217us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946563.544765:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 74 00010000:00010000:1.0:1790946563.545033:0:11315:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7200/0x16e41aef932729b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.545044:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7200/0x16e41aef932729b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.545074:0:11315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7200/0x16e41aef932729b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.545082:0:11315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7200/0x16e41aef932729b7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.545089:0:11315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7200/0x16e41aef932729b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.545120:0:11315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146be9f7200 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:1.0:1790946563.545126:0:11315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7200/0x16e41aef932729b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.545133:0:11315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7200/0x16e41aef932729b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.545143:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9146836df300) 00010000:00010000:1.0:1790946563.545147:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790946563.545303:0:11315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7200/0x16e41aef932729b7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.545312:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7200/0x16e41aef932729b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946563.545370:0:11315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b631bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+34:11554:x1877943286581760:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 12581us (12908us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946563.545379:0:11315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 195 00000100:00100000:0.0:1790946563.550726:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946563.550832:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286582400 00000100:00100000:1.0:1790946563.550936:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286582400 00000100:00100000:1.0:1790946563.551044:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 53 00000100:00100000:1.0:1790946563.551055:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b6318380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+34:11554:x1877943286582400:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:1.0:1790946563.551325:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b6318380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+35:11554:x1877943286582400:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 272us (606us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1790946563.551333:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 53 00000001:00080000:3.0:1790946563.614155:0:6700:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:3.0:1790946563.614174:0:6700:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:0.0:1790946563.653149:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946563.653264:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286582656 00000100:00100000:3.0:1790946563.653274:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286582656 00000100:00100000:3.0:1790946563.653329:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 196 00000100:00100000:3.0:1790946563.653339:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b6318a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+35:11565:x1877943286582656:12345-192.168.203.13@tcp:101:cat.0 00010000:00010000:3.0:1790946563.653362:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946563.653381:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6a00/0x16e41aef932729be lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cf68 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.653447:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef932729c5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.653461:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef932729c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.653472:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef932729c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.653503:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7600/0x16e41aef932729cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.653510:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7600/0x16e41aef932729cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.653516:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7600/0x16e41aef932729cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.653755:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7a00/0x16e41aef932729d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.653764:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7a00/0x16e41aef932729d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.653771:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7a00/0x16e41aef932729d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790946563.653781:0:5834:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:3.0:1790946563.653880:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef932729c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.653889:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef932729c5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.653895:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef932729c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.653901:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146be9f6800 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946563.653905:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef932729c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.653920:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef932729c5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.653931:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff914686750d00) 00010000:00010000:3.0:1790946563.653933:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946563.653938:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef932729c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.653944:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef932729c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.653956:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7600/0x16e41aef932729cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.653962:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7600/0x16e41aef932729cc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.653968:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7600/0x16e41aef932729cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.653972:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146be9f7600 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946563.653975:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7600/0x16e41aef932729cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.653981:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7600/0x16e41aef932729cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.653989:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9146836df900) 00010000:00010000:3.0:1790946563.653991:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946563.653994:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7600/0x16e41aef932729cc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.654009:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7600/0x16e41aef932729cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.654048:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6a00/0x16e41aef932729be lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf68 expref: 38 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.654061:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7a00/0x16e41aef932729d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf68 expref: 37 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.654067:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9146836df300) 00010000:00010000:3.0:1790946563.654069:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790946563.654072:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146be9f7a00, rc 0) 00000100:00100000:3.0:1790946563.654134:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b6318a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+37:11565:x1877943286582656:12345-192.168.203.13@tcp:101:cat.0 Request processed in 795us (993us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1790946563.654141:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 196 00000100:00100000:3.0:1790946563.666084:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946563.666168:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286582912 00000100:00100000:2.0:1790946563.666178:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286582912 00000100:00100000:2.0:1790946563.666368:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 54 00000100:00100000:2.0:1790946563.666379:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beee4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+37:11565:x1877943286582912:12345-192.168.203.13@tcp:35:cat.0 00000100:00100000:2.0:1790946563.666625:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beee4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+38:11565:x1877943286582912:12345-192.168.203.13@tcp:35:cat.0 Request processed in 246us (548us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1790946563.666632:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 54 00000100:00100000:0.0:1790946563.687845:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946563.688228:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286583168 00000100:00100000:2.0:1790946563.688239:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286583168 00000100:00100000:2.0:1790946563.688397:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 197 00000100:00100000:2.0:1790946563.688408:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b631b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+38:11566:x1877943286583168:12345-192.168.203.13@tcp:36:rm.0 00010000:00010000:2.0:1790946563.688470:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1790946563.688497:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7a00/0x16e41aef932729d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf68 expref: 38 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946563.688519:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef932729a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf61 expref: 37 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946563.688532:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6600/0x16e41aef93272971 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf53 expref: 36 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946563.688542:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9146836df300) 00010000:00010000:2.0:1790946563.688553:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790946563.688589:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef932729e1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946563.688604:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef932729e1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946563.688629:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef932729e1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946563.688644:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefa00/0x16e41aef932729e8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946563.688651:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefa00/0x16e41aef932729e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946563.688658:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefa00/0x16e41aef932729e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946563.688892:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef932729ef lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946563.688902:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef932729ef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946563.688909:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef932729ef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790946563.690719:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:2.0:1790946563.690742:0:5836:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 348762539960ns, next at 349762534546ns, rc = 0 00010000:00010000:2.0:1790946563.690820:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef932729f6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946563.690836:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef932729f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946563.690857:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef932729f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946563.690878:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef932729f6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946563.690885:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef932729f6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946563.690891:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef932729f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946563.690918:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790946563.690941:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef932729ef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946563.690948:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef932729ef lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946563.690955:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef932729ef lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946563.690960:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aee600 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:2.0:1790946563.690965:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef932729ef lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946563.690972:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef932729ef lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946563.690982:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9146a0a5ea00) 00010000:00010000:2.0:1790946563.690985:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1790946563.690990:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef932729ef lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946563.691006:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef932729ef lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946563.691025:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef932729e1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946563.691031:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef932729e1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946563.691037:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef932729e1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946563.691043:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aee000 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:2.0:1790946563.691046:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef932729e1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946563.691052:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef932729e1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946563.691061:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff914686750d00) 00010000:00010000:2.0:1790946563.691063:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790946563.691066:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef932729e1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946563.691072:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee000/0x16e41aef932729e1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790946563.691080:0:5836:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000006fe17ae6 reply state 00000000e17784f1 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefa00/0x16e41aef932729e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946563.691088:0:5836:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790946563.691183:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b631b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+37:11566:x1877943286583168:12345-192.168.203.13@tcp:36:rm.0 Request processed in 2773us (3344us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1790946563.691191:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 197 00010000:00010000:1.0:1790946563.691712:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790946563.691720:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef932729f6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.691740:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aef800 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:1.0:1790946563.691744:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef932729f6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.691751:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef932729f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.691762:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9146a0a5ea00) 00010000:00010000:1.0:1790946563.691764:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1790946563.691768:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef932729f6 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.691774:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef932729f6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.691791:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946563.691793:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946563.691794:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946563.693589:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefa00/0x16e41aef932729e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.693606:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefa00/0x16e41aef932729e8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.693614:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefa00/0x16e41aef932729e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.693620:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aefa00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946563.693624:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefa00/0x16e41aef932729e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.693651:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefa00/0x16e41aef932729e8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.693667:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9146a0a5ec00) 00010000:00010000:3.0:1790946563.693670:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946563.693675:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefa00/0x16e41aef932729e8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.693683:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefa00/0x16e41aef932729e8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946563.768939:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946563.769193:0:11315:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286583424 00000100:00100000:1.0:1790946563.769247:0:11315:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286583424 00000100:00100000:1.0:1790946563.769312:0:11315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 198 00000100:00100000:1.0:1790946563.769322:0:11315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5eb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+36:11572:x1877943286583424:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:1.0:1790946563.769347:0:11315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946563.769369:0:11315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef932729fd lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cf6f expref: -99 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.769483:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272a04 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.769518:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272a04 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.769530:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272a04 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.769547:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef93272a0b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.769554:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef93272a0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.769561:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef93272a0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790946563.770072:0:11315:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:1.0:1790946563.770262:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93272a12 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.770273:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93272a12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.770281:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93272a12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.770313:0:11315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272a04 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.770320:0:11315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272a04 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.770326:0:11315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272a04 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.770339:0:11315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180f800 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:1.0:1790946563.770343:0:11315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272a04 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.770350:0:11315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272a04 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.770362:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff914686750d00) 00010000:00010000:1.0:1790946563.770364:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790946563.770369:0:11315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272a04 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.770375:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272a04 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790946563.770389:0:11315:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000005a1de7cd reply state 000000005e03c573 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef93272a0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946563.770397:0:11315:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790946563.770423:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef932729fd lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf6f expref: 39 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.770437:0:11315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93272a12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf6f expref: 38 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946563.770445:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91469e29dd00) 00010000:00010000:1.0:1790946563.770447:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790946563.770450:0:11315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b180f600, rc 0) 00000100:00100000:1.0:1790946563.770530:0:11315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5eb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+39:11572:x1877943286583424:12345-192.168.203.13@tcp:101:bash.0 Request processed in 1209us (1600us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1790946563.770544:0:11315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 198 00010000:00010000:2.0:1790946563.773045:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef93272a0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946563.773063:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef93272a0b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946563.773071:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef93272a0b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946563.773078:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180fa00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:2.0:1790946563.773082:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef93272a0b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946563.773089:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef93272a0b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946563.773103:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91469e29df00) 00010000:00010000:2.0:1790946563.773106:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790946563.773111:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef93272a0b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946563.773118:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef93272a0b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946563.773701:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946563.773772:0:12075:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286583552 00000100:00100000:3.0:1790946563.773782:0:12075:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286583552 00000100:00100000:3.0:1790946563.773847:0:12075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 60 00000100:00100000:3.0:1790946563.773857:0:12075:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91469829f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+5:2364:x1877943286583552:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:3.0:1790946563.773873:0:12075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946563.773893:0:12075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7836b3d/0x16e41aef93272a20 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cf76 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790946563.773919:0:12075:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790946563.773936:0:12075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=348s v=(0 0) 00010000:00010000:3.0:1790946563.773941:0:12075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790946563.773964:0:12075:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7836b3d/0x16e41aef93272a20 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf76 expref: 6 pid: 12075 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.773982:0:12075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b7836b3d/0x16e41aef93272a20 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf76 expref: 6 pid: 12075 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.774013:0:12075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146be9f6a00, rc 0) 00000100:00100000:3.0:1790946563.774063:0:12075:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91469829f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2364:x1877943286583552:12345-192.168.203.13@tcp:101:bash.0 Request processed in 207us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946563.774071:0:12075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 60 00000100:00080000:1.0:1790946563.774520:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790946563.781817:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946563.781893:0:6808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286583680 00000100:00100000:0.0:1790946563.781903:0:6808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286583680 00000100:00100000:0.0:1790946563.781969:0:6808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 61 00000100:00100000:0.0:1790946563.781979:0:6808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bdcc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:11572:x1877943286583680:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:0.0:1790946563.781997:0:6808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946563.782014:0:6808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005115528b/0x16e41aef93272a27 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cf7d expref: -99 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946563.782046:0:6808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b7836b3d/0x16e41aef93272a20 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf76 expref: 7 pid: 12075 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946563.782068:0:6808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946563.782073:0:6808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946563.782079:0:6808:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005115528b/0x16e41aef93272a27 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf7d expref: 7 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946563.782112:0:6808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b7836b3d/0x16e41aef93272a20 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf76 expref: 7 pid: 12075 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946563.782127:0:6808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b7836b3d/0x16e41aef93272a20 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf76 expref: 7 pid: 12075 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946563.782142:0:6808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5eb2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6808:1877943303352704:192.168.203.13@tcp:104: 00000100:00100000:0.0:1790946563.782262:0:6808:0:(client.c:2716:ptlrpc_set_wait()) set ffff914684855300 going to sleep for 11 seconds 00000100:00100000:0.0:1790946563.785774:0:6808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5eb2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6808:1877943303352704:192.168.203.13@tcp:104: 00010000:00010000:0.0:1790946563.785809:0:6808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005115528b/0x16e41aef93272a27 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf7d expref: 7 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946563.785829:0:6808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b1932800, rc 0) 00000100:00100000:0.0:1790946563.785923:0:6808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bdcc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+7:11572:x1877943286583680:12345-192.168.203.13@tcp:101:bash.0 Request processed in 3944us (4114us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946563.785932:0:6808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 61 00000100:00100000:1.0:1790946563.798538:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946563.799262:0:5820:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286583808 00000100:00100000:3.0:1790946563.799274:0:5820:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286583808 00010000:00010000:3.0:1790946563.799316:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b7836b3d/0x16e41aef93272a20 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf76 expref: 7 pid: 12075 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946563.799351:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 75 00000100:00100000:3.0:1790946563.799361:0:5820:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914685710c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+7:2364:x1877943286583808:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790946563.799376:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790946563.799398:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b7836b3d/0x16e41aef93272a20 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf76 expref: 7 pid: 12075 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.799413:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b7836b3d/0x16e41aef93272a20 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf76 expref: 7 pid: 12075 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.799434:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7836b3d/0x16e41aef93272a20 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf76 expref: 7 pid: 12075 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.799451:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790946563.799455:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790946563.799464:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005115528b/0x16e41aef93272a27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf7d expref: 6 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.799489:0:5820:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005115528b/0x16e41aef93272a27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf7d expref: 6 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946563.799528:0:5820:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005115528b/0x16e41aef93272a27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf7d expref: 6 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946563.799543:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146beee7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5820:1877943303352832:192.168.203.13@tcp:105: 00000100:00100000:3.0:1790946563.800480:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff914681254600 going to sleep for 11 seconds 00000100:00100000:3.0:1790946563.803127:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146beee7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5820:1877943303352832:192.168.203.13@tcp:105: 00010000:00010000:3.0:1790946563.803155:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790946563.803338:0:5820:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914685710c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2364:x1877943286583808:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 3977us (4808us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946563.803351:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 75 00000100:00100000:0.0:1790946563.817579:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946563.817673:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946563.817699:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946563.817740:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946563.817759:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946563.817784:0:12075:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286584064 00000100:00100000:0.0:1790946563.817792:0:12075:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286584064 00000100:00100000:0.0:1790946563.817833:0:12075:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286584320 00000100:00100000:0.0:1790946563.817836:0:12075:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286584320 00000100:00100000:0.0:1790946563.817859:0:12075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 88 00000100:00100000:0.0:1790946563.817868:0:12075:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5eb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+9:2363:x1877943286584320:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790946563.818670:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 62 00000100:00100000:3.0:1790946563.818682:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5eb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2361:x1877943286584064:12345-192.168.203.13@tcp:16:kworker.0 00000100:00100000:3.0:1790946563.818787:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5eb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2361:x1877943286584064:12345-192.168.203.13@tcp:16:kworker.0 Request processed in 109us (1232us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946563.818795:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 62 00000100:00100000:3.0:1790946563.818820:0:6681:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286583936 00000100:00100000:3.0:1790946563.818825:0:6681:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286583936 00002000:00100000:3.0:1790946563.818852:0:6681:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9146b5eb3b80 x1877943286583936/t0(0) o4->7eed1f4b-bd5b-4a70-8045-59db065b3dfc@192.168.203.13@tcp:504/0 lens 504/0 e 0 to 0 dl 1790946574 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790946563.818862:0:6681:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9146b5eb3b80 with x1877943286583936 ext(0->8) 00002000:00010000:3.0:1790946563.818877:0:6681:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9146b5eb3b80 00000100:00100000:3.0:1790946563.818900:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:3.0:1790946563.818907:0:6681:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+6:2361:x1877943286583936:12345-192.168.203.13@tcp:4:bash.0 00000100:00100000:3.0:1790946563.819373:0:6681:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+8:2361:x1877943286583936:12345-192.168.203.13@tcp:4:bash.0 Request processed in 464us (1698us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1790946563.819380:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 7 00002000:00100000:3.0:1790946563.819387:0:6681:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9146b5eb3b80 x1877943286583936/t4294967308(0) o4->7eed1f4b-bd5b-4a70-8045-59db065b3dfc@192.168.203.13@tcp:504/0 lens 504/448 e 0 to 0 dl 1790946574 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790946563.819395:0:6681:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9146b5eb3b80 with x1877943286583936 ext(0->8) 00002000:00010000:3.0:1790946563.819398:0:6681:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9146b5eb3b80 00000100:00100000:3.0:1790946563.819445:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286584192 00000100:00100000:3.0:1790946563.819450:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286584192 00000100:00100000:3.0:1790946563.819483:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 298 00000100:00100000:3.0:1790946563.819489:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:2363:x1877943286584192:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790946563.819516:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:2363:x1877943286584192:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 27us (1816us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946563.819523:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 298 00000100:00100000:3.0:1790946563.819604:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946563.820921:0:12075:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5eb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+9:2363:x1877943286584320:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 70us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946563.820938:0:12075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 88 00000100:00100000:1.0:1790946563.821058:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286584448 00000100:00100000:1.0:1790946563.821066:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286584448 00000100:00100000:1.0:1790946563.821131:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 154 00000100:00100000:1.0:1790946563.821139:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+5:2363:x1877943286584448:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790946563.821227:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+5:2363:x1877943286584448:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 61us (3459us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946563.821233:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 154 00000100:00100000:1.0:1790946563.821264:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286584704 00000100:00100000:1.0:1790946563.821269:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286584704 00000100:00100000:1.0:1790946563.821296:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 55 00000100:00100000:1.0:1790946563.821302:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beee4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+38:11572:x1877943286584704:12345-192.168.203.13@tcp:35:bash.0 00000100:00100000:1.0:1790946563.821594:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beee4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+39:11572:x1877943286584704:12345-192.168.203.13@tcp:35:bash.0 Request processed in 291us (1989us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1790946563.821601:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 55 00000100:00080000:0.0:1790946563.822134:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790946564.038101:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946564.038297:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286584832 00000100:00100000:2.0:1790946564.038307:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286584832 00000100:00100000:2.0:1790946564.038365:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 199 00000100:00100000:2.0:1790946564.038374:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beee7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+39:11588:x1877943286584832:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1790946564.038413:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946564.038436:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef93272a2e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cf84 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946564.038500:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef93272a35 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946564.038514:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef93272a35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946564.038525:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef93272a35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790946564.038560:0:5836:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1790946564.038564:0:5836:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790946564.038592:0:5836:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef93272a35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946564.038616:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef93272a2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf84 expref: 41 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946564.038633:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef93272a35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf84 expref: 40 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946564.038642:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff914686750d00) 00010000:00010000:2.0:1790946564.038645:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790946564.038649:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914688aee400, rc 0) 00000100:00100000:2.0:1790946564.038710:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beee7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+40:11588:x1877943286584832:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 337us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946564.038718:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 199 00000100:00100000:2.0:1790946564.048086:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946564.048179:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286585088 00000100:00100000:3.0:1790946564.048189:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286585088 00000100:00100000:3.0:1790946564.048286:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 200 00000100:00100000:3.0:1790946564.048296:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be131f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+40:11588:x1877943286585088:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1790946564.048316:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946564.048336:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7600/0x16e41aef93272a3c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cf8b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.048451:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6a00/0x16e41aef93272a43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.048465:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6a00/0x16e41aef93272a43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.048476:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6a00/0x16e41aef93272a43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790946564.048487:0:5834:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1790946564.048620:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7600/0x16e41aef93272a3c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf8b expref: 43 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.048638:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6a00/0x16e41aef93272a43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf8b expref: 42 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.048646:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91469e29dd00) 00010000:00010000:3.0:1790946564.048649:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790946564.048652:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146be9f6a00, rc 0) 00000100:00100000:3.0:1790946564.048716:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be131f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+42:11588:x1877943286585088:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 420us (638us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1790946564.048724:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 200 00000100:00100000:3.0:1790946564.054267:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946564.054330:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946564.054398:0:5819:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286585472 00000100:00100000:0.0:1790946564.054408:0:5819:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286585472 00000100:00100000:2.0:1790946564.054469:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286585344 00000100:00100000:2.0:1790946564.054475:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286585344 00000100:00100000:0.0:1790946564.054476:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00100000:0.0:1790946564.054490:0:5819:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146875b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+43:2363:x1877943286585472:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790946564.054506:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790946564.054525:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 201 00010000:00010000:0.0:1790946564.054533:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6a00/0x16e41aef93272a43 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf8b expref: 43 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946564.054538:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be075c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+43:11588:x1877943286585344:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1790946564.054560:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91469e29dd00) 00010000:00010000:2.0:1790946564.054565:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946564.054566:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790946564.054598:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef93272a51 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cf92 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946564.054636:0:5819:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146875b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+43:2363:x1877943286585472:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 149us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946564.054646:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 15 00010000:00010000:2.0:1790946564.054688:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeee00/0x16e41aef93272a58 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946564.054702:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeee00/0x16e41aef93272a58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946564.054712:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeee00/0x16e41aef93272a58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790946564.054723:0:5835:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1790946564.054833:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef000/0x16e41aef93272a51 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf92 expref: 45 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946564.054848:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeee00/0x16e41aef93272a58 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf92 expref: 44 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946564.054856:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91469e29dd00) 00010000:00010000:2.0:1790946564.054859:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1790946564.054862:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914688aeee00, rc 0) 00000100:00100000:2.0:1790946564.054886:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be075c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+44:11588:x1877943286585344:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 353us (629us total) trans 4294967486 rc 0/0 00000100:00100000:2.0:1790946564.054905:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 201 00000100:00100000:2.0:1790946564.060139:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946564.060358:0:6808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286585600 00000100:00100000:0.0:1790946564.060369:0:6808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286585600 00000100:00100000:0.0:1790946564.060441:0:6808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 63 00000100:00100000:0.0:1790946564.060450:0:6808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be130a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+8:2364:x1877943286585600:12345-192.168.203.13@tcp:1:lfs.0 00010000:00010000:0.0:1790946564.060494:0:6808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b0a99b5/0x16e41aef93272a66 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.060515:0:6808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005115528b/0x16e41aef93272a27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf7d expref: 8 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.060523:0:6808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1790946564.060528:0:6808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790946564.060533:0:6808:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b0a99b5/0x16e41aef93272a66 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.060581:0:6808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005115528b/0x16e41aef93272a27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf7d expref: 8 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.060596:0:6808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005115528b/0x16e41aef93272a27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf7d expref: 8 pid: 6808 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946564.060610:0:6808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5eb0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6808:1877943303352960:192.168.203.13@tcp:104: 00000100:00100000:0.0:1790946564.060701:0:6808:0:(client.c:2716:ptlrpc_set_wait()) set ffff914684855300 going to sleep for 11 seconds 00000100:00100000:0.0:1790946564.063510:0:6808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5eb0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6808:1877943303352960:192.168.203.13@tcp:104: 00010000:00010000:0.0:1790946564.063540:0:6808:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000b0a99b5/0x16e41aef93272a66 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946564.064953:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946564.067154:0:5820:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286585728 00000100:00100000:3.0:1790946564.067169:0:5820:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286585728 00010000:00010000:3.0:1790946564.067291:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005115528b/0x16e41aef93272a27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf7d expref: 9 pid: 6808 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946564.067418:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 76 00000100:00100000:3.0:1790946564.067441:0:5820:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be133800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+9:2364:x1877943286585728:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790946564.067457:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1790946564.067485:0:5820:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1790946564.067489:0:5820:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1790946563 00002000:00010000:3.0:1790946564.067491:0:5820:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1790946563 00010000:00010000:3.0:1790946564.067497:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005115528b/0x16e41aef93272a27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf7d expref: 9 pid: 6808 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.067512:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005115528b/0x16e41aef93272a27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf7d expref: 9 pid: 6808 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.067535:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005115528b/0x16e41aef93272a27 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf7d expref: 9 pid: 6808 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.067554:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790946564.067558:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790946564.067581:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000b0a99b5/0x16e41aef93272a66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.067591:0:5820:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b0a99b5/0x16e41aef93272a66 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.067627:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790946564.067695:0:5820:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be133800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+8:2364:x1877943286585728:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 268us (2748us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946564.067703:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 76 00010000:00010000:2.0:1790946564.067773:0:6808:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000b0a99b5/0x16e41aef93272a66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946564.067783:0:6808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b0a99b5/0x16e41aef93272a66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946564.067809:0:6808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b0a99b5/0x16e41aef93272a66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946564.067830:0:6808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b0a99b5/0x16e41aef93272a66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946564.067839:0:6808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b0a99b5/0x16e41aef93272a66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946564.067846:0:6808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1933800 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:2.0:1790946564.067851:0:6808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b0a99b5/0x16e41aef93272a66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946564.067860:0:6808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b0a99b5/0x16e41aef93272a66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946564.067872:0:6808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b0a99b5/0x16e41aef93272a66 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946564.067887:0:6808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b0a99b5/0x16e41aef93272a66 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946564.067958:0:6808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be130a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+7:2364:x1877943286585600:12345-192.168.203.13@tcp:1:lfs.0 Request processed in 7509us (7828us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946564.067966:0:6808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 63 00000100:00100000:2.0:1790946564.071990:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946564.072086:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286585984 00000100:00100000:1.0:1790946564.072097:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286585984 00000100:00100000:1.0:1790946564.072175:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 56 00000100:00100000:1.0:1790946564.072185:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b2652050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+43:11588:x1877943286585984:12345-192.168.203.13@tcp:35:lfs.0 00000004:00010000:1.0:1790946564.072276:0:5837:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeee00/0x16e41aef93272a58 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf92 expref: 43 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790946564.072642:0:5837:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:1.0:1790946564.072683:0:5837:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:1.0:1790946564.073107:0:5837:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967489 00010000:00010000:1.0:1790946564.073161:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef93272a6d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946564.073178:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93272a12 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf6f expref: 47 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946564.073188:0:5837:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef93272a6d lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946564.073360:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93272a12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf6f expref: 47 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946564.073376:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93272a12 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf6f expref: 47 pid: 11315 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946564.073391:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bdcc9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5837:1877943303353088:192.168.203.13@tcp:104: 00000100:00100000:1.0:1790946564.073592:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff91468574f600 going to sleep for 11 seconds 00000100:00100000:2.0:1790946564.076804:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bdcc9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5837:1877943303353088:192.168.203.13@tcp:104: 00010000:00010000:2.0:1790946564.077031:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef93272a6d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946564.078053:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946564.078766:0:5821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286586112 00000100:00100000:3.0:1790946564.078776:0:5821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286586112 00010000:00010000:3.0:1790946564.079070:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93272a12 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf6f expref: 48 pid: 11315 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946564.079117:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 77 00000100:00100000:3.0:1790946564.079127:0:5821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be132680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+48:2363:x1877943286586112:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790946564.079142:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790946564.079149:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93272a12 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf6f expref: 48 pid: 11315 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.079162:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93272a12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf6f expref: 48 pid: 11315 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.079183:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93272a12 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf6f expref: 48 pid: 11315 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.079387:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91469e29dd00) 00010000:00010000:3.0:1790946564.079394:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef93272a6d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.079404:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef93272a6d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.079411:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef93272a6d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946564.079660:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790946564.079722:0:5821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be132680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+47:2363:x1877943286586112:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 596us (1672us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946564.079730:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 77 00000100:00100000:0.0:1790946564.080546:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be0f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1877943303353472:0@lo:400:kworker.0 00000100:00100000:0.0:1790946564.080614:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946564.080647:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790946564.080653:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be0f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303353600:0@lo:400:kworker.0 00000100:00100000:0.0:1790946564.080678:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946564.080714:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303353472 00000100:00100000:0.0:1790946564.080721:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303353472 00000100:00080000:0.0:1790946564.080742:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790946564.080775:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1790946564.080783:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be0f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877943303353472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946564.080833:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be0f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877943303353472:12345-0@lo:400:kworker.0 Request processed in 51us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946564.080841:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1790946564.080874:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be0f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1877943303353472:0@lo:400:kworker.0 00000100:00100000:3.0:1790946564.080951:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be0f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1877943303353344:0@lo:400:kworker.0 00000100:00100000:3.0:1790946564.080982:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946564.081011:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be0f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303353856:0@lo:400:kworker.0 00000100:00100000:3.0:1790946564.081033:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946564.081051:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1790946564.081057:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5eb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3301:1877943303353216:0@lo:400:kworker.0 00000100:00100000:3.0:1790946564.081083:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946564.081108:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be0f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1877943303353728:0@lo:400:kworker.0 00000100:00100000:3.0:1790946564.081130:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946564.081157:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303353216 00000100:00100000:3.0:1790946564.081161:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303353216 00000100:00100000:3.0:1790946564.081186:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1790946564.081193:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3301:x1877943303353216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946564.081255:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3301:x1877943303353216:12345-0@lo:400:kworker.0 Request processed in 63us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946564.081262:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1790946564.081289:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303353600 00000100:00100000:3.0:1790946564.081293:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303353600 00000100:00100000:3.0:1790946564.081318:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303353856 00000100:00100000:3.0:1790946564.081320:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303353856 00000100:00100000:3.0:1790946564.081341:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1790946564.081347:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be0f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303353600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946564.081381:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be0f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303353600:12345-0@lo:400:kworker.0 Request processed in 34us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946564.081387:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1790946564.081408:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1790946564.081414:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3301:x1877943303353856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946564.081443:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3301:x1877943303353856:12345-0@lo:400:kworker.0 Request processed in 29us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946564.081449:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1790946564.081478:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5eb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3301:1877943303353216:0@lo:400:kworker.0 00000100:00100000:3.0:1790946564.081490:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be0f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303353856:0@lo:400:kworker.0 00000100:00100000:3.0:1790946564.081511:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303353344 00000100:00100000:3.0:1790946564.081515:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303353344 00000100:00100000:3.0:1790946564.081540:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303353728 00000100:00100000:3.0:1790946564.081542:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303353728 00000100:00100000:3.0:1790946564.081558:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1790946564.081564:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b6319180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1877943303353344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946564.081609:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b6319180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1877943303353344:12345-0@lo:400:kworker.0 Request processed in 44us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946564.081615:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1790946564.081626:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1790946564.081631:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1877943303353728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946564.081670:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1877943303353728:12345-0@lo:400:kworker.0 Request processed in 39us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946564.081675:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1790946564.081705:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be0f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1877943303353728:0@lo:400:kworker.0 00000100:00100000:3.0:1790946564.081714:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be0f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1877943303353344:0@lo:400:kworker.0 00000100:00080000:0.0:1790946564.081839:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790946564.081844:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790946564.081846:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790946564.081864:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:0.0:1790946564.081869:0:3302:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:0.0:1790946564.081888:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9146be126680, transno 4294967307 00000100:00100000:0.0:1790946564.081908:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be0f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303353600:0@lo:400:kworker.0 00010000:00010000:2.0:1790946564.085672:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef93272a6d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946564.085690:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef93272a6d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790946564.085816:0:5837:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:2.0:1790946564.087054:0:5837:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1790946564.087182:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be132d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5837:1877943303353984:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1790946564.087699:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946564.087733:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff914682df5180 going to sleep for 11 seconds 00000100:00100000:1.0:1790946564.088439:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303353984 00000100:00100000:1.0:1790946564.088449:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303353984 00000100:00100000:1.0:1790946564.088507:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790946564.088517:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be131180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5837:x1877943303353984:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1790946564.088641:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be131180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5837:x1877943303353984:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 125us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946564.088648:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790946564.088735:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be132d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5837:1877943303353984:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1790946564.089265:0:5837:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:3.0:1790946564.089335:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cfca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5837:1877943303354112:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1790946564.089376:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946564.089406:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146b6571e40 going to sleep for 11 seconds 00000100:00100000:1.0:1790946564.089636:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303354112 00000100:00100000:1.0:1790946564.089642:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303354112 00000100:00100000:1.0:1790946564.089670:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790946564.089677:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5837:x1877943303354112:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1790946564.089837:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5837:x1877943303354112:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 160us (460us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1790946564.089844:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790946564.089925:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cfca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5837:1877943303354112:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1790946564.090029:0:5837:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:3.0:1790946564.090066:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef93272a6d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.090077:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef93272a6d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.090085:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef93272a6d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.090091:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180fa00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946564.090096:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef93272a6d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.090104:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef93272a6d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.090118:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91469e29dd00) 00010000:00010000:3.0:1790946564.090121:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1790946564.090126:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef93272a6d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.090131:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef93272a6d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790946564.090418:0:5837:0:(mdd_object.c:4180:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1790946564.090517:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:3.0:1790946564.090528:0:5837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 349162327247ns, next at 350162325075ns, rc = 0 00000001:00080000:3.0:1790946564.090535:0:5837:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:3.0:1790946564.090663:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91469e29dd00) 00010000:00010000:3.0:1790946564.090668:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1790946564.090676:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeee00/0x16e41aef93272a58 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf92 expref: 51 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946564.090817:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b2652050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+50:11588:x1877943286585984:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 18633us (19003us total) trans 4294967495 rc 0/0 00000100:00100000:3.0:1790946564.090826:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 56 00000020:00080000:3.0:1790946564.090831:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1790946564.095146:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946564.095456:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286586240 00000100:00100000:3.0:1790946564.095466:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286586240 00000100:00100000:3.0:1790946564.095511:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 202 00000100:00100000:3.0:1790946564.095518:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be130e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+50:11588:x1877943286586240:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1790946564.095540:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946564.095562:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7600/0x16e41aef93272a74 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cf99 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.095636:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7600/0x16e41aef93272a74 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf99 expref: 51 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.095650:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7600/0x16e41aef93272a74 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf99 expref: 51 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.095666:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9146836df400) 00010000:00010000:3.0:1790946564.095669:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790946564.095685:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146be9f7600, rc 0) 00000100:00100000:3.0:1790946564.095739:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be130e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+51:11588:x1877943286586240:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 221us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946564.095746:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 202 00000100:00100000:1.0:1790946564.104362:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946564.104583:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286586496 00000100:00100000:3.0:1790946564.104594:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286586496 00000100:00100000:3.0:1790946564.104651:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 57 00000100:00100000:3.0:1790946564.104662:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bdcc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+51:11588:x1877943286586496:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:3.0:1790946564.104893:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bdcc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+52:11588:x1877943286586496:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 232us (539us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1790946564.104901:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 57 00000100:00100000:2.0:1790946564.240609:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946564.240731:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286586624 00000100:00100000:0.0:1790946564.240741:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286586624 00000100:00100000:0.0:1790946564.240803:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 203 00000100:00100000:0.0:1790946564.240814:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be132300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+52:11598:x1877943286586624:12345-192.168.203.13@tcp:34:lfs.0 00010000:00010000:0.0:1790946564.240888:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272a7b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.240922:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272a7b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.240932:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272a7b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.240950:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272a82 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.240957:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272a82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.240964:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272a82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.241048:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272a89 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.241056:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272a89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.241062:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272a89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790946564.241114:0:5836:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272a89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.241126:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272a7b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.241132:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272a7b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.241149:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272a7b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.241156:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1932400 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:0.0:1790946564.241160:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272a7b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.241168:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272a7b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.241179:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff914686750d00) 00010000:00010000:0.0:1790946564.241182:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790946564.241186:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272a7b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.241192:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272a7b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.241243:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272a82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.241250:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272a82 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.241256:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272a82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.241261:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1932800 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:0.0:1790946564.241264:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272a82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.241280:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272a82 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.241288:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff914686750200) 00010000:00010000:0.0:1790946564.241291:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790946564.241295:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272a82 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.241301:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272a82 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.241317:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272a89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.241322:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272a89 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.241328:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272a89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.241334:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1933800 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:0.0:1790946564.241337:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272a89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.241343:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272a89 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.241349:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9146836df400) 00010000:00010000:0.0:1790946564.241352:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790946564.241355:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272a89 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.241371:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272a89 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946564.241447:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be132300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+52:11598:x1877943286586624:12345-192.168.203.13@tcp:34:lfs.0 Request processed in 634us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946564.241455:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 203 00000100:00100000:0.0:1790946564.314522:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946564.314721:0:11315:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286586880 00000100:00100000:1.0:1790946564.314731:0:11315:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286586880 00000100:00100000:1.0:1790946564.314789:0:11315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 204 00000100:00100000:1.0:1790946564.314799:0:11315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be0f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+52:11601:x1877943286586880:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1790946564.314820:0:11315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946564.314839:0:11315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef93272a90 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cfa0 expref: -99 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946564.314920:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93272a97 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946564.314935:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93272a97 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946564.314947:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93272a97 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946564.314980:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272a9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946564.314989:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272a9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946564.314997:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272a9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946564.315120:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272aa5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946564.315129:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272aa5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946564.315137:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272aa5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790946564.315146:0:11315:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1790946564.315293:0:11315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93272a97 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946564.315301:0:11315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93272a97 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946564.315308:0:11315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93272a97 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946564.315314:0:11315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180f600 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:1.0:1790946564.315319:0:11315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93272a97 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946564.315338:0:11315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93272a97 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946564.315349:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff914686750d00) 00010000:00010000:1.0:1790946564.315352:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790946564.315358:0:11315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93272a97 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946564.315364:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93272a97 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946564.315377:0:11315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272a9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946564.315383:0:11315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272a9e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946564.315389:0:11315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272a9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946564.315393:0:11315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180e600 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:1.0:1790946564.315396:0:11315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272a9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946564.315402:0:11315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272a9e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946564.315409:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91469e29dc00) 00010000:00010000:1.0:1790946564.315412:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790946564.315414:0:11315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272a9e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946564.315428:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272a9e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946564.315471:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef93272a90 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfa0 expref: 55 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946564.315485:0:11315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272aa5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfa0 expref: 54 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946564.315492:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9146836df400) 00010000:00010000:1.0:1790946564.315495:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790946564.315498:0:11315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b180f800, rc 0) 00000100:00100000:1.0:1790946564.315581:0:11315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be0f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+54:11601:x1877943286586880:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 783us (1069us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1790946564.315588:0:11315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 204 00000100:00100000:1.0:1790946564.320300:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946564.324640:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286587008 00000100:00100000:0.0:1790946564.324656:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286587008 00000100:00100000:0.0:1790946564.324724:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 205 00000100:00100000:0.0:1790946564.324735:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bdcc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+54:11601:x1877943286587008:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:0.0:1790946564.324805:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272ab3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.324824:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.324836:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.324861:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.324869:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272ab3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.324876:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272ab3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.324882:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1933800 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:0.0:1790946564.324914:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272ab3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.324923:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272ab3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.324936:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9146836df400) 00010000:00010000:0.0:1790946564.324939:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790946564.324956:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272ab3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.324962:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272ab3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946564.325051:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bdcc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+54:11601:x1877943286587008:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 318us (4759us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946564.325060:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 205 00000100:00100000:2.0:1790946564.329548:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946564.329720:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286587264 00000100:00100000:3.0:1790946564.329730:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286587264 00000100:00100000:3.0:1790946564.329819:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 58 00000100:00100000:3.0:1790946564.329829:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be133b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+54:11601:x1877943286587264:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:3.0:1790946564.330190:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be133b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+55:11601:x1877943286587264:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 361us (650us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1790946564.330229:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 58 00010000:00010000:3.0:1790946564.405660:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946564.433759:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946564.433852:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286587520 00000100:00100000:0.0:1790946564.433863:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286587520 00000100:00100000:0.0:1790946564.433926:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 206 00000100:00100000:0.0:1790946564.433936:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be131880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+55:11611:x1877943286587520:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:0.0:1790946564.436494:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946564.436501:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1790946564.436533:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef93272a35 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf84 expref: 55 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.436552:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff914686750d00) 00010000:00010000:0.0:1790946564.436556:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790946564.436584:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272aba lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cfa7 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.436704:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272ac1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.436719:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272aa5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfa0 expref: 55 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.436728:0:5836:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272ac1 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.436763:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272aa5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfa0 expref: 55 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.436779:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272aa5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfa0 expref: 55 pid: 11315 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946564.436792:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be0f7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5836:1877943303354240:192.168.203.13@tcp:104: 00000100:00100000:0.0:1790946564.436966:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff914684855300 going to sleep for 11 seconds 00000100:00100000:0.0:1790946564.443652:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be0f7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5836:1877943303354240:192.168.203.13@tcp:104: 00010000:00010000:0.0:1790946564.443680:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272ac1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946564.448638:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946564.448880:0:5820:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286587648 00000100:00100000:3.0:1790946564.448898:0:5820:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286587648 00010000:00010000:3.0:1790946564.448961:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272aa5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfa0 expref: 56 pid: 11315 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946564.449012:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 78 00000100:00100000:3.0:1790946564.449023:0:5820:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be132a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+56:2363:x1877943286587648:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790946564.449068:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790946564.449078:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272aa5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfa0 expref: 56 pid: 11315 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.450617:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272aa5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfa0 expref: 56 pid: 11315 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.450675:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272aa5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfa0 expref: 56 pid: 11315 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.450700:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9146836df400) 00010000:00010000:3.0:1790946564.450706:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272ac1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.450718:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272ac1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.450728:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272ac1 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.450775:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790946564.450838:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272ac1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.450855:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272ac1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946564.450873:0:5820:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be132a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+55:2363:x1877943286587648:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 1848us (2248us total) trans 0 rc 0/0 00000004:00200000:0.0:1790946564.450880:0:5836:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00000100:00100000:3.0:1790946564.450888:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 78 00010000:00010000:0.0:1790946564.451267:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272aba lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfa7 expref: 56 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.451291:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272ac1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfa7 expref: 55 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.451300:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9146836df400) 00010000:00010000:0.0:1790946564.451303:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790946564.451306:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b1932800, rc 0) 00000100:00100000:0.0:1790946564.451380:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be131880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+55:11611:x1877943286587520:12345-192.168.203.13@tcp:101:bash.0 Request processed in 17445us (17630us total) trans 4294967499 rc 0/0 00000100:00100000:0.0:1790946564.451389:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 206 00000100:00100000:2.0:1790946564.459322:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946564.459923:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286587904 00000100:00100000:3.0:1790946564.459941:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286587904 00000100:00100000:0.0:1790946564.460069:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 207 00000100:00100000:0.0:1790946564.460102:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be131c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+55:11611:x1877943286587904:12345-192.168.203.13@tcp:36:bash.0 00010000:00010000:0.0:1790946564.460402:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272acf lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.460419:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272acf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.460430:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272acf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790946564.460480:0:5834:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967500 00000004:00010000:0.0:1790946564.460505:0:5834:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000009af58019 reply state 00000000d38bf995 transno 4294967501 ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272acf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946564.460513:0:5834:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790946564.460623:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be131c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+58:11611:x1877943286587904:12345-192.168.203.13@tcp:36:bash.0 Request processed in 541us (1310us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1790946564.460647:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 207 00000020:00080000:0.0:1790946564.460653:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790946564.462457:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272acf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.462472:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272acf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.462494:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272acf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.462500:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1933800 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946564.462504:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272acf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.462512:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272acf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.462526:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9146836df400) 00010000:00010000:3.0:1790946564.462529:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946564.462533:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272acf lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.462540:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272acf lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946564.463049:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946564.463121:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286588032 00000100:00100000:1.0:1790946564.463130:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286588032 00000100:00100000:1.0:1790946564.463182:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 208 00000100:00100000:1.0:1790946564.463191:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be130700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+57:11611:x1877943286588032:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:1.0:1790946564.463251:0:6803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946564.463267:0:6803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93272ad6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cfae expref: -99 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946564.463343:0:6803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272add lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946564.463369:0:6803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272ac1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfa7 expref: 58 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946564.463376:0:6803:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272add lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946564.463407:0:6803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272ac1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfa7 expref: 58 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946564.463420:0:6803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272ac1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfa7 expref: 58 pid: 5836 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946564.463434:0:6803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be84a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6803:1877943303354368:192.168.203.13@tcp:104: 00000100:00100000:1.0:1790946564.463504:0:6803:0:(client.c:2716:ptlrpc_set_wait()) set ffff91468574f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790946564.468144:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946564.468227:0:5821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286588160 00000100:00100000:1.0:1790946564.468236:0:5821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286588160 00010000:00010000:1.0:1790946564.468274:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272ac1 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfa7 expref: 59 pid: 5836 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946564.468312:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 79 00000100:00100000:1.0:1790946564.468321:0:5821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be0f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+59:2363:x1877943286588160:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790946564.468337:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790946564.468344:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272ac1 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfa7 expref: 59 pid: 5836 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946564.468356:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272ac1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfa7 expref: 59 pid: 5836 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946564.468392:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9146836df400) 00010000:00010000:1.0:1790946564.468396:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272add lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946564.468405:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272add lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946564.468411:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272add lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946564.468430:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790946564.468485:0:5821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be0f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+59:2363:x1877943286588160:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 164us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946564.468492:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 79 00010000:00010000:2.0:1790946564.468629:0:6803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272ac1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfa7 expref: 58 pid: 5836 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946564.468645:0:6803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be84a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6803:1877943303354368:192.168.203.13@tcp:104: 00010000:00010000:2.0:1790946564.468664:0:6803:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272add lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946564.468673:0:6803:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272add lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946564.468679:0:6803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272add lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790946564.468723:0:6803:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1790946564.468728:0:6803:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790946564.468749:0:6803:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272add lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946564.468778:0:6803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93272ad6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfae expref: 58 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946564.468792:0:6803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272add lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfae expref: 57 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946564.468798:0:6803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9146836df400) 00010000:00010000:2.0:1790946564.468801:0:6803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790946564.468810:0:6803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b180e600, rc 0) 00000100:00100000:2.0:1790946564.468834:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be130700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+57:11611:x1877943286588032:12345-192.168.203.13@tcp:101:bash.0 Request processed in 5644us (5789us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946564.468841:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 208 00000100:00100000:1.0:1790946564.481492:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946564.481597:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286588416 00000100:00100000:2.0:1790946564.481607:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286588416 00000100:00100000:2.0:1790946564.481671:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 59 00000100:00100000:2.0:1790946564.481681:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be84a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+57:11611:x1877943286588416:12345-192.168.203.13@tcp:35:bash.0 00000100:00100000:2.0:1790946564.481904:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be84a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+58:11611:x1877943286588416:12345-192.168.203.13@tcp:35:bash.0 Request processed in 224us (420us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1790946564.481911:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 59 00000100:00100000:3.0:1790946564.542817:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946564.543001:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286588544 00000100:00100000:0.0:1790946564.543014:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286588544 00000100:00100000:0.0:1790946564.543094:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 209 00000100:00100000:0.0:1790946564.543115:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146becb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+58:11617:x1877943286588544:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1790946564.543147:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946564.543172:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef93272ae4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cfb5 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.543316:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272aeb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.543335:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272aeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.543348:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272aeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790946564.543392:0:5836:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1790946564.543397:0:5836:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790946564.543420:0:5836:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272aeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.543449:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef93272ae4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfb5 expref: 60 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.543471:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272aeb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfb5 expref: 59 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.543498:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff914686750d00) 00010000:00010000:0.0:1790946564.543501:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790946564.543504:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b1932400, rc 0) 00000100:00100000:0.0:1790946564.544687:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146becb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+59:11617:x1877943286588544:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 1565us (1877us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946564.544700:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 209 00000100:00100000:0.0:1790946564.551628:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946564.551875:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286588672 00000100:00100000:3.0:1790946564.551889:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286588672 00000100:00100000:3.0:1790946564.551966:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 210 00000100:00100000:3.0:1790946564.551978:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be0f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+59:11617:x1877943286588672:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1790946564.552005:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946564.552033:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef93272af2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cfbc expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.552127:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7000/0x16e41aef93272af9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.552168:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7000/0x16e41aef93272af9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.552182:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7000/0x16e41aef93272af9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.552487:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7800/0x16e41aef93272b00 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.552498:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7800/0x16e41aef93272b00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.552507:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7800/0x16e41aef93272b00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.552796:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6a00/0x16e41aef93272b07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.552807:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6a00/0x16e41aef93272b07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.552815:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6a00/0x16e41aef93272b07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790946564.552860:0:5834:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1790946564.552865:0:5834:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790946564.552891:0:5834:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6a00/0x16e41aef93272b07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.552904:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6a00/0x16e41aef93272b07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.552929:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7000/0x16e41aef93272af9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.552936:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7000/0x16e41aef93272af9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.552944:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7000/0x16e41aef93272af9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.552950:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146be9f7000 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946564.552955:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7000/0x16e41aef93272af9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.552964:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7000/0x16e41aef93272af9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.552978:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff914686750d00) 00010000:00010000:3.0:1790946564.552982:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946564.552987:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7000/0x16e41aef93272af9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.552994:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7000/0x16e41aef93272af9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.553009:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7800/0x16e41aef93272b00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.553016:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7800/0x16e41aef93272b00 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.553022:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7800/0x16e41aef93272b00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.553037:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146be9f7800 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946564.553040:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7800/0x16e41aef93272b00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.553045:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7800/0x16e41aef93272b00 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.553053:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9146836df100) 00010000:00010000:3.0:1790946564.553055:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946564.553058:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7800/0x16e41aef93272b00 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.553064:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7800/0x16e41aef93272b00 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.554661:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef93272af2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfbc expref: 61 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.554701:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6a00/0x16e41aef93272b07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfbc expref: 60 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.554711:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9146836df400) 00010000:00010000:3.0:1790946564.554714:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790946564.554718:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146be9f6a00, rc 0) 00000100:00100000:3.0:1790946564.554830:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be0f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+60:11617:x1877943286588672:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 2852us (3214us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946564.554841:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 210 00000100:00100000:1.0:1790946564.561545:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946564.561774:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946564.562482:0:5820:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286588800 00000100:00100000:3.0:1790946564.562517:0:5820:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286588800 00000100:00100000:2.0:1790946564.562683:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286589056 00000100:00100000:2.0:1790946564.562689:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286589056 00000100:00100000:2.0:1790946564.562744:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 211 00000100:00100000:2.0:1790946564.562756:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+61:11617:x1877943286589056:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1790946564.562781:0:6803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946564.562806:0:6803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef93272b0e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cfc3 expref: -99 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946564.562947:0:6803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef93272b15 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946564.562967:0:6803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272add lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfae expref: 62 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946564.562977:0:6803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6a00/0x16e41aef93272b07 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfbc expref: 62 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946564.563000:0:6803:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef93272b15 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00100000:2.0:1790946564.563031:0:6803:0:(ldlm_lockd.c:2635:ldlm_cancel_hpreq_lock_match()) @@@ Prio raised by lock 0x16e41aef93272b07 req@ffff9146bee3a680 x1877943286588800/t0(0) o103->7eed1f4b-bd5b-4a70-8045-59db065b3dfc@192.168.203.13@tcp:505/0 lens 328/0 e 0 to 0 dl 1790946575 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1790946564.563082:0:6803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6a00/0x16e41aef93272b07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfbc expref: 62 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946564.563960:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 80 00000100:00100000:1.0:1790946564.563981:0:5821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+62:2363:x1877943286588800:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790946564.564002:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790946564.564007:0:6803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6a00/0x16e41aef93272b07 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfbc expref: 62 pid: 5834 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946564.564013:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6a00/0x16e41aef93272b07 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfbc expref: 62 pid: 5834 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946564.564038:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6a00/0x16e41aef93272b07 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfbc expref: 62 pid: 5834 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946564.564041:0:6803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be133100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6803:1877943303354496:192.168.203.13@tcp:104: 00010000:00010000:1.0:1790946564.564170:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9146836df400) 00010000:00010000:1.0:1790946564.564188:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef93272b15 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946564.564198:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef93272b15 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946564.564219:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790946564.564940:0:6803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272add lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfae expref: 62 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946564.564960:0:6803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272add lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfae expref: 62 pid: 6803 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946564.564973:0:6803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be130380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6803:1877943303354624:192.168.203.13@tcp:104: 00000100:00100000:1.0:1790946564.565778:0:5821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+62:2363:x1877943286588800:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 1800us (4241us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946564.565793:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 80 00000100:00100000:2.0:1790946564.565808:0:6803:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146b602c0c0 going to sleep for 11 seconds 00010000:00010000:2.0:1790946564.571488:0:6803:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.13@tcp) returned -22 from blocking AST (req@00000000aca50426 x1877943303354496) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6a00/0x16e41aef93272b07 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfbc expref: 61 pid: 5834 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946564.571521:0:6803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6a00/0x16e41aef93272b07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfbc expref: 61 pid: 5834 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946564.571628:0:6803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be133100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6803:1877943303354496:192.168.203.13@tcp:104: 00000100:00100000:2.0:1790946564.571657:0:6803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be130380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6803:1877943303354624:192.168.203.13@tcp:104: 00010000:00010000:2.0:1790946564.571687:0:6803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9146836df400) 00010000:00010000:2.0:1790946564.571693:0:6803:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef93272b15 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946564.571703:0:6803:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef93272b15 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946564.571713:0:6803:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef93272b15 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946564.574083:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946564.574325:0:5819:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286589184 00000100:00100000:0.0:1790946564.574338:0:5819:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286589184 00010000:00010000:0.0:1790946564.574391:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272add lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfae expref: 61 pid: 6803 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946564.574440:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 81 00000100:00100000:0.0:1790946564.574451:0:5819:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914685710450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+61:2364:x1877943286589184:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790946564.574470:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790946564.574477:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272add lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfae expref: 61 pid: 6803 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.574492:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272add lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfae expref: 61 pid: 6803 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.574519:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272add lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfae expref: 61 pid: 6803 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.574540:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9146836df400) 00010000:00010000:0.0:1790946564.574574:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef93272b15 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.574586:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef93272b15 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.574595:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef93272b15 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.574972:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790946564.575067:0:5819:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914685710450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+60:2364:x1877943286589184:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 615us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946564.575139:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 81 00010000:00010000:2.0:1790946564.576865:0:6803:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef93272b15 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946564.577030:0:6803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef93272b15 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790946564.577060:0:6803:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1790946564.577536:0:6803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefc00/0x16e41aef93272b0e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfc3 expref: 61 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946564.577558:0:6803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef93272b15 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfc3 expref: 60 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946564.577578:0:6803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9146836df400) 00010000:00010000:2.0:1790946564.577581:0:6803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790946564.577604:0:6803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914688aef200, rc 0) 00000100:00100000:2.0:1790946564.577886:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+60:11617:x1877943286589056:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 15130us (16109us total) trans 4294967503 rc 0/0 00000100:00100000:2.0:1790946564.577897:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 211 00000100:00100000:2.0:1790946564.592594:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be0f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303354752:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790946564.592726:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946564.592904:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303354752 00000100:00100000:3.0:1790946564.592914:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303354752 00000100:00100000:3.0:1790946564.592974:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790946564.592983:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be130380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1877943303354752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790946564.593033:0:6678:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790946564.593096:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be130380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1877943303354752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946564.593103:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790946564.593195:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be0f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303354752:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790946564.594881:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946564.594979:0:5821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286589440 00000100:00100000:0.0:1790946564.594991:0:5821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286589440 00000100:00100000:0.0:1790946564.595067:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:0.0:1790946564.595077:0:5821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+60:11617:x1877943286589440:12345-192.168.203.13@tcp:103:lfs.0 00010000:00010000:0.0:1790946564.595108:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790946564.595140:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7600/0x16e41aef93272a74 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf99 expref: 60 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.595165:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9146836df400) 00010000:00010000:0.0:1790946564.595172:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790946564.595299:0:5821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+59:11617:x1877943286589440:12345-192.168.203.13@tcp:103:lfs.0 Request processed in 223us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946564.595306:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:1.0:1790946564.600134:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946564.600292:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286589568 00000100:00100000:0.0:1790946564.600306:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286589568 00000100:00100000:0.0:1790946564.600370:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 212 00000100:00100000:0.0:1790946564.600389:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be162680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+59:11617:x1877943286589568:12345-192.168.203.13@tcp:58:lfs.0 00010000:00010000:0.0:1790946564.600532:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272b23 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.600678:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272b23 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946564.600696:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272b23 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790946564.601014:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1790946564.601247:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be162680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+59:11617:x1877943286589568:12345-192.168.203.13@tcp:58:lfs.0 Request processed in 815us (1083us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946564.601256:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 212 00000100:00100000:1.0:1790946564.611399:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946564.611667:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286589696 00000100:00100000:3.0:1790946564.611680:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286589696 00000100:00100000:3.0:1790946564.611796:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 213 00000100:00100000:3.0:1790946564.611809:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be162d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+59:11617:x1877943286589696:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1790946564.611848:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946564.611876:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef93272b2a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cfca expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.611951:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272b23 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.611964:0:5834:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef93272b2a lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfca expref: 60 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.611987:0:5834:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272b23 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.612002:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef93272b2a lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfca expref: 60 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.612041:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9146836df400) 00010000:00010000:3.0:1790946564.612044:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790946564.612049:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef93272b2a lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfca expref: 60 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946564.612056:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146be9f6800, rc 0) 00000100:00100000:3.0:1790946564.612133:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be162d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+60:11617:x1877943286589696:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 327us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946564.612141:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 213 00010000:00010000:1.0:1790946565.424365:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790946565.424576:0:11687:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790946565.424582:0:11687:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790946565.424628:0:11687:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1790946565.424636:0:11687:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790946565.425886:0:11687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be133100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11687:1877943303354880:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790946565.426020:0:11687:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146b602c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790946565.429938:0:11687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be133100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11687:1877943303354880:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790946565.435272:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946565.435404:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286589824 00000100:00100000:2.0:1790946565.435414:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286589824 00000100:00100000:2.0:1790946565.435495:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 214 00000100:00080000:0.0:1790946565.435499:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790946565.435511:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be161180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+60:11619:x1877943286589824:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790946565.435542:0:6803:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790946565.435865:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be161180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+60:11619:x1877943286589824:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 359us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946565.435872:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 214 00000100:00100000:1.0:1790946565.445092:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946565.445195:0:11315:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286589952 00000100:00100000:3.0:1790946565.445239:0:11315:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286589952 00000100:00100000:3.0:1790946565.445295:0:11315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 215 00000100:00100000:3.0:1790946565.445305:0:11315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be160e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+60:11619:x1877943286589952:12345-192.168.203.13@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1790946565.445376:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7800/0x16e41aef93272b31 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946565.445393:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7800/0x16e41aef93272b31 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946565.445406:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7800/0x16e41aef93272b31 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946565.445422:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7000/0x16e41aef93272b38 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946565.445429:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7000/0x16e41aef93272b38 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946565.445453:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7000/0x16e41aef93272b38 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946565.445477:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6600/0x16e41aef93272b3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946565.445485:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6600/0x16e41aef93272b3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946565.445492:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6600/0x16e41aef93272b3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790946565.445532:0:11315:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1790946565.445536:0:11315:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790946565.445551:0:11315:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6600/0x16e41aef93272b3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946565.445574:0:11315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7800/0x16e41aef93272b31 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946565.445583:0:11315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7800/0x16e41aef93272b31 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946565.445591:0:11315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7800/0x16e41aef93272b31 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946565.445598:0:11315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146be9f7800 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946565.445602:0:11315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7800/0x16e41aef93272b31 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946565.445610:0:11315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7800/0x16e41aef93272b31 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946565.445629:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9146a0a5e900) 00010000:00010000:3.0:1790946565.445632:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946565.445638:0:11315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7800/0x16e41aef93272b31 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946565.445645:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7800/0x16e41aef93272b31 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946565.445656:0:11315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7000/0x16e41aef93272b38 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946565.445662:0:11315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7000/0x16e41aef93272b38 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946565.445668:0:11315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7000/0x16e41aef93272b38 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946565.445673:0:11315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146be9f7000 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946565.445677:0:11315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7000/0x16e41aef93272b38 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946565.445682:0:11315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7000/0x16e41aef93272b38 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946565.445689:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9146836df100) 00010000:00010000:3.0:1790946565.445691:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946565.445694:0:11315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7000/0x16e41aef93272b38 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946565.445699:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7000/0x16e41aef93272b38 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946565.445725:0:11315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6600/0x16e41aef93272b3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946565.445731:0:11315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6600/0x16e41aef93272b3f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946565.445736:0:11315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6600/0x16e41aef93272b3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946565.445741:0:11315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146be9f6600 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946565.445753:0:11315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6600/0x16e41aef93272b3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946565.445759:0:11315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6600/0x16e41aef93272b3f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946565.445767:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9146836df400) 00010000:00010000:3.0:1790946565.445769:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946565.445772:0:11315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6600/0x16e41aef93272b3f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946565.445777:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6600/0x16e41aef93272b3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946565.445854:0:11315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be160e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+60:11619:x1877943286589952:12345-192.168.203.13@tcp:34:lhsmtool_posix.0 Request processed in 549us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946565.445863:0:11315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 215 00000100:00100000:1.0:1790946565.459970:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946565.460047:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286590208 00000100:00100000:3.0:1790946565.460057:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286590208 00000100:00100000:3.0:1790946565.460110:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 216 00000100:00100000:3.0:1790946565.460131:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be162300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+60:11619:x1877943286590208:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790946565.460152:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946565.460169:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6600/0x16e41aef93272b46 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cfd1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946565.460286:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7000/0x16e41aef93272b4d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946565.460300:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7000/0x16e41aef93272b4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946565.460311:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7000/0x16e41aef93272b4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790946565.460321:0:5834:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1790946565.460402:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7000/0x16e41aef93272b4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946565.460409:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7000/0x16e41aef93272b4d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946565.460416:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7000/0x16e41aef93272b4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946565.460421:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146be9f7000 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946565.460426:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7000/0x16e41aef93272b4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946565.460432:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7000/0x16e41aef93272b4d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946565.460442:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9146836df400) 00010000:00010000:3.0:1790946565.460452:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790946565.460457:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7000/0x16e41aef93272b4d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946565.460463:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7000/0x16e41aef93272b4d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946565.460499:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6600/0x16e41aef93272b46 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfd1 expref: 62 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946565.460508:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9146a0a5e900) 00010000:00010000:3.0:1790946565.460510:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790946565.460514:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6600/0x16e41aef93272b46 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfd1 expref: 62 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946565.460522:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146be9f6600, rc 0) 00000100:00100000:3.0:1790946565.460582:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be162300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+61:11619:x1877943286590208:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 452us (620us total) trans 4294967504 rc 301/301 00000100:00100000:3.0:1790946565.460590:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 216 00000100:00100000:1.0:1790946565.471944:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946565.472860:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286590336 00000100:00100000:2.0:1790946565.472872:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286590336 00000100:00100000:2.0:1790946565.472938:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 217 00000100:00100000:2.0:1790946565.472948:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be163b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+61:11619:x1877943286590336:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790946565.472998:0:6803:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790946565.473827:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be163b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+61:11619:x1877943286590336:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 877us (1894us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946565.473836:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 217 00000100:00100000:0.0:1790946565.479728:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946565.479853:0:11315:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286590592 00000100:00100000:3.0:1790946565.479864:0:11315:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286590592 00000100:00100000:3.0:1790946565.479921:0:11315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 218 00000100:00100000:3.0:1790946565.479931:0:11315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be0f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+61:11619:x1877943286590592:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790946565.479950:0:11315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946565.479953:0:11315:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1790946565.479978:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272aeb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfb5 expref: 61 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946565.480042:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff914686750d00) 00010000:00010000:3.0:1790946565.480061:0:11315:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790946565.480075:0:11315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6600/0x16e41aef93272b5b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cfd8 expref: -99 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790946565.480543:0:11315:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:3.0:1790946565.480707:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7000/0x16e41aef93272b62 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946565.480720:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7000/0x16e41aef93272b62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946565.480731:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7000/0x16e41aef93272b62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946565.480981:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6600/0x16e41aef93272b5b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfd8 expref: 63 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946565.480997:0:11315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7000/0x16e41aef93272b62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfd8 expref: 62 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946565.481005:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9146836df100) 00010000:00010000:3.0:1790946565.481007:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790946565.481010:0:11315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146be9f7000, rc 0) 00000100:00100000:3.0:1790946565.481067:0:11315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be0f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+62:11619:x1877943286590592:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 1136us (1347us total) trans 4294967505 rc 0/0 00000100:00100000:3.0:1790946565.481075:0:11315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 218 00000100:00100000:1.0:1790946565.492194:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946565.492336:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286590848 00000100:00100000:0.0:1790946565.492347:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286590848 00000100:00100000:0.0:1790946565.492412:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 219 00000100:00100000:0.0:1790946565.492423:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be161880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+62:11619:x1877943286590848:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790946565.492483:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790946565.492511:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7000/0x16e41aef93272b62 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfd8 expref: 62 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.492531:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9146836df100) 00010000:00010000:0.0:1790946565.492543:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790946565.492576:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272b70 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.492606:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272b70 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.492616:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272b70 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.492631:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272b77 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x99bbf759 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.492638:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272b77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x99bbf759 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.492644:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272b77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x99bbf759 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.492708:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272b70 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.492715:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272b70 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.492722:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272b70 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.492727:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1932800 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:0.0:1790946565.492731:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272b70 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.492738:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272b70 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.492761:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff914686750d00) 00010000:00010000:0.0:1790946565.492769:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790946565.492774:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272b70 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.492779:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272b70 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.492790:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272b77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x99bbf759 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.492795:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272b77 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x99bbf759 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.492799:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272b77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x99bbf759 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.492804:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1932400 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:0.0:1790946565.492806:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272b77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x99bbf759 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.492812:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272b77 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x99bbf759 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.492819:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x99bbf759 (ffff914686750200) 00010000:00010000:0.0:1790946565.492821:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790946565.492823:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272b77 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x99bbf759 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.492828:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272b77 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x99bbf759 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946565.492910:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be161880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+61:11619:x1877943286590848:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 489us (726us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790946565.492925:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 219 00000100:00100000:1.0:1790946565.497279:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946565.497472:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286590976 00000100:00100000:2.0:1790946565.497482:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286590976 00000100:00100000:2.0:1790946565.497535:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 220 00000100:00100000:2.0:1790946565.497544:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be162a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+61:11619:x1877943286590976:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790946565.497575:0:6803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946565.497598:0:6803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef93272b7e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cfdf expref: -99 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946565.497630:0:6803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef93272b85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946565.497643:0:6803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef93272b85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946565.497654:0:6803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef93272b85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946565.497756:0:6803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef93272b7e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfdf expref: 63 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946565.497775:0:6803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef93272b85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfdf expref: 62 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946565.497783:0:6803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9146a0a5e300) 00010000:00010000:2.0:1790946565.497792:0:6803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790946565.497796:0:6803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914688aee400, rc 0) 00000100:00100000:2.0:1790946565.497855:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be162a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+62:11619:x1877943286590976:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 311us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946565.497863:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 220 00000100:00100000:1.0:1790946565.509829:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946565.510434:0:11315:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286591232 00000100:00100000:3.0:1790946565.510447:0:11315:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286591232 00000100:00100000:3.0:1790946565.510514:0:11315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 221 00000100:00100000:3.0:1790946565.510525:0:11315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be161c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+62:11619:x1877943286591232:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790946565.510651:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6600/0x16e41aef93272b8c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946565.510671:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6600/0x16e41aef93272b8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946565.510685:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6600/0x16e41aef93272b8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790946565.510955:0:11315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:3.0:1790946565.510965:0:11315:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 350582763747ns, next at 351582761120ns, rc = 0 00000004:00010000:3.0:1790946565.511042:0:11315:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000fa28b5ff reply state 0000000078561ea9 transno 4294967506 ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6600/0x16e41aef93272b8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946565.511051:0:11315:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790946565.511149:0:11315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be161c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+64:11619:x1877943286591232:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 625us (1330us total) trans 4294967506 rc 0/0 00000100:00100000:3.0:1790946565.511157:0:11315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 221 00010000:00010000:2.0:1790946565.513531:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6600/0x16e41aef93272b8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946565.513547:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6600/0x16e41aef93272b8c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946565.513569:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6600/0x16e41aef93272b8c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946565.513575:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146be9f6600 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:2.0:1790946565.513580:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6600/0x16e41aef93272b8c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946565.513587:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6600/0x16e41aef93272b8c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946565.513602:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9146a0a5e300) 00010000:00010000:2.0:1790946565.513605:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790946565.513610:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6600/0x16e41aef93272b8c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946565.513616:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6600/0x16e41aef93272b8c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946565.517347:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946565.517622:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286591360 00000100:00100000:2.0:1790946565.517632:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286591360 00000100:00100000:2.0:1790946565.517690:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 222 00000100:00100000:2.0:1790946565.517715:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be160700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+63:11619:x1877943286591360:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790946565.517740:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946565.517760:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef93272b93 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cfe6 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946565.517820:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef93272b93 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfe6 expref: 64 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946565.517835:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef93272b93 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfe6 expref: 64 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946565.517854:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9146a0a5e300) 00010000:00010000:2.0:1790946565.517857:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790946565.517860:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914688aef800, rc 0) 00000100:00100000:2.0:1790946565.517923:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be160700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+64:11619:x1877943286591360:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 209us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946565.517930:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 222 00000100:00100000:1.0:1790946565.522988:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946565.523335:0:6808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286591488 00000100:00100000:2.0:1790946565.523345:0:6808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286591488 00000100:00100000:2.0:1790946565.523417:0:6808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 64 00000100:00100000:2.0:1790946565.523427:0:6808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be05c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+9:2364:x1877943286591488:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1790946565.523663:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790946565.524031:0:6808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be05c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+10:2364:x1877943286591488:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 Request processed in 603us (1050us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1790946565.524041:0:6808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 64 00000100:00100000:3.0:1790946565.533315:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946565.533483:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286591744 00000100:00100000:2.0:1790946565.533493:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286591744 00000100:00100000:2.0:1790946565.533580:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 60 00000100:00100000:2.0:1790946565.533590:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146becb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+64:11619:x1877943286591744:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790946565.533817:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146becb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+65:11619:x1877943286591744:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 228us (512us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1790946565.533825:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 60 00000100:00100000:1.0:1790946565.536007:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946565.536082:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286592000 00000100:00100000:3.0:1790946565.536092:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286592000 00000100:00100000:3.0:1790946565.536142:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 223 00000100:00100000:3.0:1790946565.536151:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be163100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+65:11619:x1877943286592000:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790946565.536292:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be163100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+65:11619:x1877943286592000:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 141us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946565.536300:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 223 00000100:00100000:2.0:1790946565.551481:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946565.551572:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286592128 00000100:00100000:0.0:1790946565.551582:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286592128 00000100:00100000:0.0:1790946565.551640:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 224 00000100:00100000:0.0:1790946565.551650:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be130a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+65:11619:x1877943286592128:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790946565.551669:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946565.551689:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272b9a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cfed expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.551934:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef93272ba1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.551948:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef93272ba1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.551960:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef93272ba1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790946565.551995:0:5836:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790946565.552013:0:5836:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef93272ba1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.552038:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272b9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfed expref: 67 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.552057:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef93272ba1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfed expref: 66 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.552078:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9146a0a5e300) 00010000:00010000:0.0:1790946565.552081:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1790946565.552085:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b1933a00, rc 0) 00000100:00100000:0.0:1790946565.552570:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be130a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+66:11619:x1877943286592128:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 911us (1089us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946565.552579:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 224 00000100:00100000:0.0:1790946565.561690:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946565.562914:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286592256 00000100:00100000:3.0:1790946565.562927:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286592256 00000100:00100000:3.0:1790946565.563013:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 65 00000100:00100000:3.0:1790946565.563024:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be0f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+10:2363:x1877943286592256:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790946565.563043:0:6674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946565.563065:0:6674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f0c06f4/0x16e41aef93272ba8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cff4 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790946565.563092:0:6674:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abfad05, blocks: 0x1 00010000:00010000:3.0:1790946565.563110:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=350s v=(0 0) 00010000:00010000:3.0:1790946565.563114:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790946565.563124:0:6674:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f0c06f4/0x16e41aef93272ba8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cff4 expref: 11 pid: 6674 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946565.563142:0:6674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002f0c06f4/0x16e41aef93272ba8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cff4 expref: 11 pid: 6674 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946565.563154:0:6674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146be9f7800, rc 0) 00000100:00100000:3.0:1790946565.563556:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be0f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+11:2363:x1877943286592256:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 532us (1873us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946565.563573:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 65 00000100:00100000:0.0:1790946565.586318:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946565.586438:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286592512 00000100:00100000:1.0:1790946565.586457:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286592512 00000100:00100000:1.0:1790946565.586512:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 225 00000100:00100000:1.0:1790946565.586522:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be0f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+66:11619:x1877943286592512:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1790946565.586654:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be0f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+66:11619:x1877943286592512:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 134us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946565.586661:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 225 00000100:00100000:2.0:1790946565.594096:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946565.594317:0:12075:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286592640 00000100:00100000:0.0:1790946565.594327:0:12075:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286592640 00000100:00100000:0.0:1790946565.594387:0:12075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 66 00000100:00100000:0.0:1790946565.594397:0:12075:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be133100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+11:11619:x1877943286592640:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790946565.594413:0:12075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946565.594436:0:12075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005115528b/0x16e41aef93272baf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0cffb expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.594481:0:12075:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002f0c06f4/0x16e41aef93272ba8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cff4 expref: 12 pid: 6674 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.594491:0:12075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946565.594498:0:12075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946565.594504:0:12075:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005115528b/0x16e41aef93272baf lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cffb expref: 12 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.594540:0:12075:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002f0c06f4/0x16e41aef93272ba8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cff4 expref: 12 pid: 6674 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.594589:0:12075:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002f0c06f4/0x16e41aef93272ba8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cff4 expref: 12 pid: 6674 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946565.594604:0:12075:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be0f7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12075:1877943303355008:192.168.203.13@tcp:104: 00000100:00100000:0.0:1790946565.594871:0:12075:0:(client.c:2716:ptlrpc_set_wait()) set ffff914684855600 going to sleep for 11 seconds 00000100:00100000:0.0:1790946565.598932:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946565.599028:0:5819:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286592768 00000100:00100000:1.0:1790946565.599039:0:5819:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286592768 00010000:00010000:1.0:1790946565.599078:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002f0c06f4/0x16e41aef93272ba8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cff4 expref: 13 pid: 6674 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946565.599120:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 82 00000100:00100000:1.0:1790946565.599130:0:5819:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be0f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+13:2363:x1877943286592768:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790946565.599144:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790946565.599166:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002f0c06f4/0x16e41aef93272ba8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cff4 expref: 13 pid: 6674 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946565.599179:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002f0c06f4/0x16e41aef93272ba8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cff4 expref: 13 pid: 6674 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946565.599288:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946565.599292:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946565.599301:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005115528b/0x16e41aef93272baf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cffb expref: 13 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946565.599311:0:5819:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005115528b/0x16e41aef93272baf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cffb expref: 13 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946565.599346:0:5819:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005115528b/0x16e41aef93272baf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cffb expref: 13 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946565.599373:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be160380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5819:1877943303355136:192.168.203.13@tcp:105: 00000100:00100000:1.0:1790946565.599629:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set ffff91468574f6c0 going to sleep for 11 seconds 00010000:00010000:2.0:1790946565.599999:0:12075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f0c06f4/0x16e41aef93272ba8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cff4 expref: 13 pid: 6674 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946565.600016:0:12075:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be0f7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12075:1877943303355008:192.168.203.13@tcp:104: 00010000:00010000:2.0:1790946565.600040:0:12075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005115528b/0x16e41aef93272baf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cffb expref: 12 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946565.600051:0:12075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b1932800, rc 0) 00000100:00100000:2.0:1790946565.600083:0:12075:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be133100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+12:11619:x1877943286592640:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 5688us (6002us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946565.600091:0:12075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 66 00000100:00100000:1.0:1790946565.602274:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be160380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5819:1877943303355136:192.168.203.13@tcp:105: 00010000:00010000:1.0:1790946565.602298:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790946565.605633:0:5819:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be0f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+11:2363:x1877943286592768:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 6492us (6698us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946565.605647:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 82 00000100:00100000:3.0:1790946565.606915:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946565.607324:0:6680:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286592896 00000100:00100000:1.0:1790946565.607334:0:6680:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286592896 00002000:00100000:1.0:1790946565.607384:0:6680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff91469829f480 x1877943286592896/t0(0) o4->7eed1f4b-bd5b-4a70-8045-59db065b3dfc@192.168.203.13@tcp:506/0 lens 504/0 e 0 to 0 dl 1790946576 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790946565.607395:0:6680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91469829f480 with x1877943286592896 ext(0->12) 00002000:00010000:1.0:1790946565.607400:0:6680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91469829f480 00000100:00100000:1.0:1790946565.607427:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:1.0:1790946565.607435:0:6680:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91469829f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+11:2361:x1877943286592896:12345-192.168.203.13@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1790946565.608058:0:6680:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91469829f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+13:2361:x1877943286592896:12345-192.168.203.13@tcp:4:lhsmtool_posix.0 Request processed in 621us (1147us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1790946565.608066:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 8 00002000:00100000:1.0:1790946565.608073:0:6680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff91469829f480 x1877943286592896/t4294967321(0) o4->7eed1f4b-bd5b-4a70-8045-59db065b3dfc@192.168.203.13@tcp:506/0 lens 504/448 e 0 to 0 dl 1790946576 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790946565.608081:0:6680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91469829f480 with x1877943286592896 ext(0->12) 00002000:00010000:1.0:1790946565.608084:0:6680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91469829f480 00000100:00100000:0.0:1790946565.612644:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946565.612789:0:11315:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286593024 00000100:00100000:1.0:1790946565.612799:0:11315:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286593024 00000100:00100000:1.0:1790946565.612854:0:11315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 226 00000100:00100000:1.0:1790946565.612864:0:11315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be0f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+66:11619:x1877943286593024:12345-192.168.203.13@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1790946565.681450:0:11315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be0f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+66:11619:x1877943286593024:12345-192.168.203.13@tcp:44:lhsmtool_posix.0 Request processed in 68578us (68805us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946565.681462:0:11315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 226 00000001:00080000:2.0:1790946565.683353:0:5857:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967501 is committed 00000020:00080000:2.0:1790946565.683379:0:5857:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff914687af9300 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1790946565.683384:0:5857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff914685666e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9146a334cc00 00000020:00080000:2.0:1790946565.683387:0:5857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff914685666f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9146be116400 00000020:00080000:3.0:1790946565.683438:0:5868:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 6 committed batchid 5 00000020:00080000:3.0:1790946565.683669:0:5868:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000001:00080000:2.0:1790946565.687158:0:5857:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000004:00080000:2.0:1790946565.687182:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000004:00080000:2.0:1790946565.687249:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 10 committed 00000004:00080000:2.0:1790946565.687263:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:2.0:1790946565.687283:0:5857:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9146b6571a80 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1790946565.687288:0:5857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9146beceff00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9146b6571cc0 00000020:00080000:2.0:1790946565.687292:0:5857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9146becefb00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91468353fc00 00000100:00100000:1.0:1790946565.687773:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be160380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303355264:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1790946565.687839:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1790946565.687885:0:5868:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000100:00100000:1.0:1790946565.687925:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be160000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303355392:0@lo:2:osp-syn-1-0.0 00000020:00080000:0.0:1790946565.687944:0:5868:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1790946565.687948:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946565.687965:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303355264 00000100:00100000:1.0:1790946565.687973:0:6808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303355392 00000100:00100000:0.0:1790946565.687973:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303355264 00000100:00100000:1.0:1790946565.687976:0:6808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303355392 00000100:00100000:1.0:1790946565.688026:0:6808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790946565.688035:0:6808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be161500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3300:x1877943303355392:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1790946565.688160:0:6808:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1790946565.688164:0:6808:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1790946565 00002000:00010000:1.0:1790946565.688166:0:6808:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1790946565.688168:0:6808:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1790946565 -> 1790946565 00002000:00010000:1.0:1790946565.688170:0:6808:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1790946565.688229:0:6808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be161500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3300:x1877943303355392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 194us (278us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1790946565.688409:0:6808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1790946565.690650:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946565.690818:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286593152 00000100:00100000:3.0:1790946565.690826:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286593152 00000100:00100000:2.0:1790946565.691334:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91469829f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303355520:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1790946565.691385:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946565.691442:0:12075:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303355520 00000100:00100000:2.0:1790946565.691447:0:12075:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303355520 00000100:00100000:1.0:1790946565.695877:0:6808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1790946565.695902:0:6808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be163480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3303:x1877943303355264:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1790946565.696616:0:6808:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00000004:00080000:0.0:1790946565.696728:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9146be160000/2, rc 0, transno 4294967322 00000100:00100000:0.0:1790946565.696737:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be160000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303355392:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1790946565.696846:0:6808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087470073/0x16e41aef93272bb6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946565.696887:0:6808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000def4f4a/0x16e41aef93272978 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf5a expref: 13 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946565.696895:0:6808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1790946565.696899:0:6808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790946565.696903:0:6808:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087470073/0x16e41aef93272bb6 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946565.697010:0:6808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000def4f4a/0x16e41aef93272978 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf5a expref: 13 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946565.697025:0:6808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000def4f4a/0x16e41aef93272978 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf5a expref: 13 pid: 6673 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946565.697040:0:6808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be161f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6808:1877943303355648:192.168.203.13@tcp:104: 00000100:00100000:3.0:1790946565.697078:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 69 00000100:00100000:1.0:1790946565.697122:0:6808:0:(client.c:2716:ptlrpc_set_wait()) set ffff91468574f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790946565.697169:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be130000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+13:2364:x1877943286593152:12345-192.168.203.13@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1790946565.700606:0:6808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be161f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6808:1877943303355648:192.168.203.13@tcp:104: 00010000:00010000:0.0:1790946565.700636:0:6808:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000087470073/0x16e41aef93272bb6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946565.703357:0:12075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1790946565.703375:0:12075:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be133480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3301:x1877943303355520:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1790946565.703410:0:12075:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:2.0:1790946565.703446:0:12075:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6abfad03, atime: 0x0, ctime: 0x6abfad03, blocks: 0x1 00010000:00010000:2.0:1790946565.703455:0:12075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085a6e26c/0x16e41aef93272bbd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946565.703471:0:12075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=350s v=(0 0) 00010000:00010000:2.0:1790946565.703475:0:12075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790946565.703481:0:12075:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085a6e26c/0x16e41aef93272bbd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946565.703498:0:12075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085a6e26c/0x16e41aef93272bbd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946565.703507:0:12075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085a6e26c/0x16e41aef93272bbd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946565.703523:0:12075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085a6e26c/0x16e41aef93272bbd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946565.703550:0:12075:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790946565.703995:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790946565.704003:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085a6e26c/0x16e41aef93272bbd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.704024:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aeec00 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:0.0:1790946565.704029:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085a6e26c/0x16e41aef93272bbd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.704039:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085a6e26c/0x16e41aef93272bbd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.704056:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085a6e26c/0x16e41aef93272bbd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.704063:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085a6e26c/0x16e41aef93272bbd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.704086:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946565.704090:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946565.704911:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946565.706373:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946565.706508:0:5820:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286593280 00000100:00100000:0.0:1790946565.706518:0:5820:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286593280 00010000:00010000:0.0:1790946565.706553:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000def4f4a/0x16e41aef93272978 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf5a expref: 14 pid: 6673 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946565.706605:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 83 00000100:00100000:0.0:1790946565.706614:0:5820:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be160a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+14:2363:x1877943286593280:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790946565.706629:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790946565.706634:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000def4f4a/0x16e41aef93272978 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf5a expref: 14 pid: 6673 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.706658:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000def4f4a/0x16e41aef93272978 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf5a expref: 14 pid: 6673 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.706681:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000def4f4a/0x16e41aef93272978 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf5a expref: 14 pid: 6673 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.706696:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790946565.706700:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790946565.706706:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000087470073/0x16e41aef93272bb6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.706716:0:5820:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087470073/0x16e41aef93272bb6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.706741:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790946565.706801:0:5820:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be160a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+13:2363:x1877943286593280:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 187us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946565.706808:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 83 00000100:00100000:2.0:1790946565.707570:0:12075:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be133480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3301:x1877943303355520:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4191us (16172us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1790946565.707579:0:12075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00010000:3.0:1790946565.708399:0:6808:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000087470073/0x16e41aef93272bb6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790946565.708413:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91469829f800/2, rc 0, transno 4294967310 00010000:00010000:3.0:1790946565.708415:0:6808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087470073/0x16e41aef93272bb6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946565.708425:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91469829f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303355520:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1790946565.708430:0:6808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087470073/0x16e41aef93272bb6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946565.708440:0:6808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087470073/0x16e41aef93272bb6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946565.708467:0:6808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790946565.708658:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790946565.708665:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087470073/0x16e41aef93272bb6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946565.708675:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180f800 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:1.0:1790946565.708689:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087470073/0x16e41aef93272bb6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946565.708700:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087470073/0x16e41aef93272bb6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946565.708717:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087470073/0x16e41aef93272bb6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946565.708726:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087470073/0x16e41aef93272bb6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946565.708745:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946565.708815:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946565.708819:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946565.710557:0:6808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be163480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3303:x1877943303355264:12345-0@lo:6:osp-syn-1-0.0 Request processed in 14663us (22713us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1790946565.710579:0:6808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000004:00080000:0.0:1790946565.712667:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9146be160380/2, rc 0, transno 4294967323 00000100:00100000:0.0:1790946565.712681:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be160380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303355264:0@lo:6:osp-syn-1-0.0 00000001:00080000:2.0:1790946565.758444:0:7645:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000001:00080000:2.0:1790946565.758554:0:7645:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:2.0:1790946565.758570:0:7645:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:0.0:1790946565.759025:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be130000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+8:2364:x1877943286593152:12345-192.168.203.13@tcp:16:lhsmtool_posix.0 Request processed in 61931us (68375us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946565.759036:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 69 00000100:00100000:1.0:1790946565.769498:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946565.769606:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286593536 00000100:00100000:0.0:1790946565.769630:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286593536 00000100:00100000:0.0:1790946565.769690:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 227 00000100:00100000:0.0:1790946565.769701:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be163800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+20:11619:x1877943286593536:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790946565.769753:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790946565.769781:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef93272ba1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfed expref: 20 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.769800:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9146a0a5e300) 00010000:00010000:0.0:1790946565.769805:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790946565.769835:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272bc4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.769848:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272bc4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.769857:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272bc4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790946565.770094:0:5836:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000233770e0 reply state 0000000094963039 transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272bc4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946565.770104:0:5836:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790946565.770340:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be163800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+21:11619:x1877943286593536:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 640us (850us total) trans 4294967508 rc 0/0 00000100:00100000:0.0:1790946565.770349:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 227 00010000:00010000:0.0:1790946565.773555:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272bc4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.773586:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272bc4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.773611:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272bc4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.773618:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1932400 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:0.0:1790946565.773623:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272bc4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.773631:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272bc4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.773647:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9146a0a5e300) 00010000:00010000:0.0:1790946565.773650:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790946565.773654:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272bc4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.773660:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272bc4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946565.775329:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946565.775697:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286593664 00000100:00100000:0.0:1790946565.775707:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286593664 00000100:00100000:0.0:1790946565.775766:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 71 00000100:00100000:0.0:1790946565.775775:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be161f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+7:2361:x1877943286593664:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1790946565.776000:0:6673:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1790946565.776003:0:6673:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1790946565 -> 1790946564 00002000:00010000:0.0:1790946565.776006:0:6673:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1790946563 00002000:00010000:0.0:1790946565.776008:0:6673:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1790946565 -> 1790946564 00002000:00010000:0.0:1790946565.776011:0:6673:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1790946565.776078:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be161f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+8:2361:x1877943286593664:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 Request processed in 302us (756us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1790946565.776100:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 71 00000100:00100000:3.0:1790946565.783420:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946565.783528:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286593920 00000100:00100000:0.0:1790946565.783538:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286593920 00000100:00100000:0.0:1790946565.783599:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 228 00000100:00100000:0.0:1790946565.783608:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b6318380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+20:11619:x1877943286593920:12345-192.168.203.13@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1790946565.783670:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272bcb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.783687:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef93272b85 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfdf expref: 20 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.783697:0:5834:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272bcb lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.783727:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef93272b85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfdf expref: 20 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.783740:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef93272b85 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfdf expref: 20 pid: 6803 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946565.783753:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be0f5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5834:1877943303355776:192.168.203.13@tcp:104: 00000100:00100000:0.0:1790946565.783841:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff914682b45c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790946565.787315:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946565.787618:0:5819:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286594048 00000100:00100000:1.0:1790946565.787629:0:5819:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286594048 00010000:00010000:1.0:1790946565.787675:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef93272b85 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfdf expref: 21 pid: 6803 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946565.787718:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 84 00000100:00100000:1.0:1790946565.787727:0:5819:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beee4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+21:2364:x1877943286594048:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790946565.787742:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790946565.787749:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef93272b85 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfdf expref: 21 pid: 6803 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946565.787784:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef93272b85 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfdf expref: 21 pid: 6803 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946565.787810:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9146a0a5e300) 00010000:00010000:1.0:1790946565.787816:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272bcb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946565.787827:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272bcb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946565.787835:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272bcb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946565.787855:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790946565.787904:0:5819:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beee4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+21:2364:x1877943286594048:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 179us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946565.787911:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 84 00010000:00010000:0.0:1790946565.790688:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee400/0x16e41aef93272b85 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfdf expref: 20 pid: 6803 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946565.790715:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be0f5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5834:1877943303355776:192.168.203.13@tcp:104: 00010000:00010000:0.0:1790946565.790755:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272bcb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.790764:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272bcb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.790770:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272bcb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.791015:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272bcb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.791024:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272bcb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.791032:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272bcb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.791038:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1932400 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:0.0:1790946565.791043:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272bcb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.791050:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272bcb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.791064:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9146a0a5e300) 00010000:00010000:0.0:1790946565.791068:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1790946565.791072:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272bcb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.791078:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932400/0x16e41aef93272bcb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946565.791307:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b6318380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+19:11619:x1877943286593920:12345-192.168.203.13@tcp:55:lhsmtool_posix.0 Request processed in 7698us (7894us total) trans 0 rc -22/-22 00000100:00100000:0.0:1790946565.791317:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 228 00000100:00100000:3.0:1790946565.809404:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946565.813759:0:12075:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286594176 00000100:00100000:2.0:1790946565.813774:0:12075:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286594176 00000100:00100000:2.0:1790946565.813847:0:12075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 72 00000100:00100000:2.0:1790946565.813856:0:12075:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beee4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+8:2364:x1877943286594176:12345-192.168.203.13@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1790946565.813900:0:12075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000007434a79/0x16e41aef93272bd2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946565.813919:0:12075:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005115528b/0x16e41aef93272baf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cffb expref: 8 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946565.813929:0:12075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790946565.813934:0:12075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790946565.813938:0:12075:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007434a79/0x16e41aef93272bd2 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946565.813985:0:12075:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005115528b/0x16e41aef93272baf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cffb expref: 8 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946565.814014:0:12075:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005115528b/0x16e41aef93272baf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cffb expref: 8 pid: 12075 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946565.814029:0:12075:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be131500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12075:1877943303355904:192.168.203.13@tcp:104: 00000100:00100000:2.0:1790946565.814136:0:12075:0:(client.c:2716:ptlrpc_set_wait()) set ffff914688452b40 going to sleep for 11 seconds 00000100:00100000:1.0:1790946565.818725:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946565.818806:0:12075:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be131500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12075:1877943303355904:192.168.203.13@tcp:104: 00010000:00010000:2.0:1790946565.818833:0:12075:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000007434a79/0x16e41aef93272bd2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946565.818911:0:5821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286594304 00000100:00100000:0.0:1790946565.818919:0:5821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286594304 00010000:00010000:0.0:1790946565.818954:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005115528b/0x16e41aef93272baf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cffb expref: 9 pid: 12075 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946565.819005:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 85 00000100:00100000:0.0:1790946565.819015:0:5821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914688711500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+9:2363:x1877943286594304:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790946565.819030:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790946565.819054:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005115528b/0x16e41aef93272baf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cffb expref: 9 pid: 12075 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.819066:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005115528b/0x16e41aef93272baf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cffb expref: 9 pid: 12075 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.819090:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005115528b/0x16e41aef93272baf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cffb expref: 9 pid: 12075 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.819116:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790946565.819121:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790946565.819127:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000007434a79/0x16e41aef93272bd2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.819152:0:5821:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007434a79/0x16e41aef93272bd2 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.819183:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790946565.819283:0:5821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914688711500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+8:2363:x1877943286594304:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 269us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946565.819290:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 85 00010000:00010000:2.0:1790946565.819424:0:12075:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000007434a79/0x16e41aef93272bd2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946565.819434:0:12075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007434a79/0x16e41aef93272bd2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946565.819459:0:12075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000007434a79/0x16e41aef93272bd2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946565.819468:0:12075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000007434a79/0x16e41aef93272bd2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946565.819476:0:12075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000007434a79/0x16e41aef93272bd2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946565.819494:0:12075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aef400 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:2.0:1790946565.819499:0:12075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000007434a79/0x16e41aef93272bd2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946565.819508:0:12075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000007434a79/0x16e41aef93272bd2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946565.819520:0:12075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000007434a79/0x16e41aef93272bd2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946565.819527:0:12075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007434a79/0x16e41aef93272bd2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946565.819581:0:12075:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beee4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+7:2364:x1877943286594176:12345-192.168.203.13@tcp:1:lhsmtool_posix.0 Request processed in 5726us (10187us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946565.819589:0:12075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 72 00000100:00100000:0.0:1790946565.830108:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946565.830798:0:11315:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286594560 00000100:00100000:1.0:1790946565.830809:0:11315:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286594560 00000100:00100000:1.0:1790946565.830877:0:11315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 229 00000100:00100000:1.0:1790946565.830887:0:11315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be0f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+19:11619:x1877943286594560:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1790946565.830985:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef93272bd9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946565.831003:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef93272bd9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946565.831033:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef93272bd9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.840095:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272be0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.840130:0:11315:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef93272b93 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfe6 expref: 20 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.840140:0:11315:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272be0 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.840182:0:11315:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef93272b93 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfe6 expref: 20 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.840198:0:11315:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef93272b93 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfe6 expref: 20 pid: 5835 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946565.840237:0:11315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be0f4700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11315:1877943303356032:192.168.203.13@tcp:104: 00000100:00100000:0.0:1790946565.840319:0:11315:0:(client.c:2716:ptlrpc_set_wait()) set ffff914682b45c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790946565.843714:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946565.843982:0:11315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be0f4700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11315:1877943303356032:192.168.203.13@tcp:104: 00010000:00010000:0.0:1790946565.844023:0:11315:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272be0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946565.844181:0:5820:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286594688 00000100:00100000:1.0:1790946565.844189:0:5820:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286594688 00010000:00010000:1.0:1790946565.844269:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef93272b93 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfe6 expref: 21 pid: 5835 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946565.844299:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 86 00000100:00100000:1.0:1790946565.844309:0:5820:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5eb2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+21:2363:x1877943286594688:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790946565.844324:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790946565.844331:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef93272b93 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfe6 expref: 21 pid: 5835 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946565.844342:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef93272b93 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfe6 expref: 21 pid: 5835 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946565.844363:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef800/0x16e41aef93272b93 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfe6 expref: 21 pid: 5835 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946565.844380:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9146a0a5e300) 00010000:00010000:1.0:1790946565.844385:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272be0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946565.844394:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272be0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946565.844403:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272be0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946565.844443:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790946565.844571:0:11315:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272be0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946565.844579:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272be0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790946565.844731:0:11315:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1790946565.844868:0:11315:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:2.0:1790946565.844911:0:11315:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1790946565.844997:0:11315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be131500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11315:1877943303356160:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1790946565.845053:0:11315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946565.845083:0:11315:0:(client.c:2716:ptlrpc_set_wait()) set ffff914688452d80 going to sleep for 11 seconds 00000100:00100000:1.0:1790946565.846368:0:5820:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5eb2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+23:2363:x1877943286594688:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 2053us (2656us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946565.846380:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 86 00000100:00100000:0.0:1790946565.846390:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303356160 00000100:00100000:0.0:1790946565.846400:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303356160 00000100:00100000:0.0:1790946565.846453:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790946565.846462:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be133800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:11315:x1877943303356160:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1790946565.850899:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be133800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:11315:x1877943303356160:12345-0@lo:1000:mdt00_004.0 Request processed in 4428us (5835us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946565.850914:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790946565.851904:0:11315:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:1.0:1790946565.851912:0:11315:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:1.0:1790946565.851947:0:11315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9146be160000, transno 4294967322 00000100:00100000:1.0:1790946565.851962:0:11315:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9146be160380 x1877943303355264/t4294967323(4294967323) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1790946581 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946565.851975:0:11315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be131500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11315:1877943303356160:0@lo:1000:mdt00_004.0 00000001:00080000:1.0:1790946565.857477:0:11315:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:1.0:1790946565.857628:0:11315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be849500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11315:1877943303356288:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1790946565.857709:0:11315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946565.858933:0:5839:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303356288 00000100:00100000:2.0:1790946565.858947:0:5839:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303356288 00000100:00100000:2.0:1790946565.858996:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790946565.859007:0:5839:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be84b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:11315:x1877943303356288:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1790946565.868795:0:5839:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be84b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:11315:x1877943303356288:12345-0@lo:1000:mdt00_004.0 Request processed in 9780us (11076us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1790946565.868809:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790946565.871154:0:11315:0:(client.c:2716:ptlrpc_set_wait()) set ffff91468574f900 going to sleep for 11 seconds 00000100:00100000:1.0:1790946565.871233:0:11315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be849500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11315:1877943303356288:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1790946565.871282:0:11315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272be0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946565.871292:0:11315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272be0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946565.871300:0:11315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272be0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946565.871305:0:11315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1932800 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:1.0:1790946565.871310:0:11315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272be0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946565.871337:0:11315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272be0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946565.871353:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9146a0a5e300) 00010000:00010000:1.0:1790946565.871356:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790946565.871361:0:11315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272be0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946565.871366:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272be0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946565.871401:0:11315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272b23 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946565.871406:0:11315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272b23 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946565.871411:0:11315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272b23 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946565.871415:0:11315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1933800 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:1.0:1790946565.871417:0:11315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272b23 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946565.871423:0:11315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272b23 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946565.871429:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9146836df400) 00010000:00010000:1.0:1790946565.871431:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790946565.871438:0:11315:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef93272b2a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfca expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946565.871460:0:11315:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef93272b2a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfca expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946565.871469:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef93272b2a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfca expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946565.871508:0:11315:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef93272b2a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfca expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946565.871523:0:11315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be849c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11315:1877943303356416:192.168.203.13@tcp:105: 00000100:00100000:1.0:1790946565.871604:0:11315:0:(client.c:2716:ptlrpc_set_wait()) set ffff91468574f900 going to sleep for 11 seconds 00000100:00100000:0.0:1790946565.888395:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946565.888604:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286594816 00000100:00100000:2.0:1790946565.888615:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286594816 00000100:00100000:2.0:1790946565.888673:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 61 00000100:00100000:2.0:1790946565.888683:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be0f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+24:11617:x1877943286594816:12345-192.168.203.13@tcp:49:lfs.0 00000100:00100000:2.0:1790946565.888838:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be0f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+24:11617:x1877943286594816:12345-192.168.203.13@tcp:49:lfs.0 Request processed in 156us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946565.888845:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 61 00000100:00100000:1.0:1790946565.889710:0:11315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be849c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11315:1877943303356416:192.168.203.13@tcp:105: 00010000:00010000:1.0:1790946565.889737:0:11315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272b23 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946565.889760:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272b23 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946565.889793:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272be7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946565.889805:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272be7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946565.889815:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272be7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946565.889824:0:11315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272be7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946565.889843:0:11315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272be7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946565.889850:0:11315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272be7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946565.889855:0:11315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180e600 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:1.0:1790946565.889858:0:11315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272be7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946565.889866:0:11315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272be7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946565.889877:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9146836df400) 00010000:00010000:1.0:1790946565.889880:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790946565.889884:0:11315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272be7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946565.889889:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef93272be7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946565.889899:0:11315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef93272bd9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946565.889904:0:11315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef93272bd9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946565.889910:0:11315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef93272bd9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946565.889914:0:11315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180fc00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:1.0:1790946565.890106:0:11315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef93272bd9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946565.890114:0:11315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef93272bd9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946565.890122:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9146836df400) 00010000:00010000:1.0:1790946565.890124:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790946565.890127:0:11315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef93272bd9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946565.890133:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef93272bd9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946565.890794:0:11315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be0f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+23:11619:x1877943286594560:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 59875us (60661us total) trans 4294967513 rc 0/0 00000100:00100000:1.0:1790946565.890825:0:11315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 229 00000020:00080000:1.0:1790946565.890831:0:11315:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1790946565.892483:0:11687:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790946565.892493:0:11687:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1790946565.894030:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946565.894183:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286595072 00000100:00100000:3.0:1790946565.894193:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286595072 00000100:00100000:3.0:1790946565.894281:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 230 00000100:00100000:3.0:1790946565.894291:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be0f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+23:11617:x1877943286595072:12345-192.168.203.13@tcp:58:lfs.0 00000040:00080000:3.0:1790946565.894652:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1790946565.894729:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be0f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+23:11617:x1877943286595072:12345-192.168.203.13@tcp:58:lfs.0 Request processed in 439us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946565.894743:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 230 00000040:00080000:2.0:1790946565.897477:0:11687:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1790946565.897501:0:11687:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790946565.904641:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946565.905143:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286595328 00000100:00100000:2.0:1790946565.905155:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286595328 00000100:00100000:2.0:1790946565.905249:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 62 00000100:00100000:2.0:1790946565.905260:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91469119d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+23:11619:x1877943286595328:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1790946565.906270:0:5837:0:(mdd_object.c:4180:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1790946565.906399:0:5837:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967514 00010000:00010000:2.0:1790946565.906463:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef400/0x16e41aef93272bee lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946565.906481:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef400/0x16e41aef93272bee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946565.906494:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef400/0x16e41aef93272bee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946565.906502:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef400/0x16e41aef93272bee lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946565.906508:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef400/0x16e41aef93272bee lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946565.906514:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef400/0x16e41aef93272bee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946565.906528:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1790946565.906643:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91469119d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+25:11619:x1877943286595328:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 1383us (2009us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1790946565.906652:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 62 00000020:00080000:2.0:1790946565.906658:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790946565.906885:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790946565.906892:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef400/0x16e41aef93272bee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.906900:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aef400 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:0.0:1790946565.906903:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef400/0x16e41aef93272bee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.906911:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef400/0x16e41aef93272bee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.906938:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9146a0a5ee00) 00010000:00010000:0.0:1790946565.906941:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1790946565.906946:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef400/0x16e41aef93272bee lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.906952:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef400/0x16e41aef93272bee lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.906983:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946565.906985:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946565.906986:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946565.964909:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946565.965049:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286595456 00000100:00100000:3.0:1790946565.965060:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286595456 00000100:00100000:3.0:1790946565.965119:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 231 00000100:00100000:3.0:1790946565.965129:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be0f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+25:11621:x1877943286595456:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1790946565.965153:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946565.965176:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7200/0x16e41aef93272bf5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0d002 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946565.965284:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7a00/0x16e41aef93272bfc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946565.965300:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7a00/0x16e41aef93272bfc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946565.965314:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7a00/0x16e41aef93272bfc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946565.965330:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6e00/0x16e41aef93272c03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946565.965338:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6e00/0x16e41aef93272c03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946565.965346:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6e00/0x16e41aef93272c03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.965822:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272c0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.965834:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef93272b15 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfc3 expref: 26 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.965853:0:5834:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272c0a lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.965890:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef93272b15 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfc3 expref: 26 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.965906:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef93272b15 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfc3 expref: 26 pid: 6803 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946565.965921:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be0f4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5834:1877943303356544:192.168.203.13@tcp:104: 00000100:00100000:0.0:1790946565.966023:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff914682b45c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790946565.971725:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946565.972623:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be0f4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5834:1877943303356544:192.168.203.13@tcp:104: 00010000:00010000:0.0:1790946565.972651:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272c0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946565.974276:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286595712 00000100:00100000:2.0:1790946565.974288:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286595712 00000100:00100000:2.0:1790946565.974367:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 63 00000100:00100000:2.0:1790946565.974377:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be849c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+27:5599:x1877943286595712:12345-192.168.203.13@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1790946565.974627:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be849c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+28:5599:x1877943286595712:12345-192.168.203.13@tcp:35:ldlm_bl.0 Request processed in 250us (2910us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1790946565.974634:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 63 00000100:00100000:3.0:1790946565.986296:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946565.986430:0:5821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286595840 00000100:00100000:0.0:1790946565.986449:0:5821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286595840 00010000:00010000:0.0:1790946565.986490:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef93272b15 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfc3 expref: 28 pid: 6803 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946565.986548:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 87 00000100:00100000:0.0:1790946565.986567:0:5821:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914685713050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+28:2363:x1877943286595840:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790946565.986583:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790946565.986590:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef93272b15 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfc3 expref: 28 pid: 6803 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.986602:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef93272b15 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfc3 expref: 28 pid: 6803 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.986622:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef93272b15 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfc3 expref: 28 pid: 6803 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.986638:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9146836df400) 00010000:00010000:0.0:1790946565.986643:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272c0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.986653:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272c0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.986661:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272c0a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946565.986812:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790946565.986880:0:5821:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914685713050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+27:2363:x1877943286595840:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 322us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946565.986887:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 87 00010000:00010000:2.0:1790946565.988058:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272c0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946565.988082:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272c0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790946565.988126:0:5834:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1790946565.988130:0:5834:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790946565.988150:0:5834:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272c0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946565.988165:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272c0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946565.988175:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7a00/0x16e41aef93272bfc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946565.988182:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7a00/0x16e41aef93272bfc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946565.988189:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7a00/0x16e41aef93272bfc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946565.988195:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146be9f7a00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:2.0:1790946565.988246:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7a00/0x16e41aef93272bfc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946565.988256:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7a00/0x16e41aef93272bfc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946565.988270:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff914686750d00) 00010000:00010000:2.0:1790946565.988273:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790946565.988277:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7a00/0x16e41aef93272bfc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946565.988293:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7a00/0x16e41aef93272bfc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946565.988306:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6e00/0x16e41aef93272c03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946565.988312:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6e00/0x16e41aef93272c03 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946565.988318:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6e00/0x16e41aef93272c03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946565.988323:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146be9f6e00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:2.0:1790946565.988326:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6e00/0x16e41aef93272c03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946565.988332:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6e00/0x16e41aef93272c03 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946565.988340:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9146836df300) 00010000:00010000:2.0:1790946565.988343:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790946565.988346:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6e00/0x16e41aef93272c03 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946565.988352:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6e00/0x16e41aef93272c03 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946565.988389:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7200/0x16e41aef93272bf5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d002 expref: 27 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946565.988403:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272c0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d002 expref: 26 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946565.988416:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9146836df400) 00010000:00010000:2.0:1790946565.988419:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790946565.988421:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b1932800, rc 0) 00000100:00100000:2.0:1790946565.988610:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be0f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+26:11621:x1877943286595456:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 23481us (23711us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946565.988619:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 231 00010000:00010000:3.0:1790946566.455910:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946566.641008:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790946566.641129:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be133b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303356672:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790946566.641333:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946566.642076:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303356672 00000100:00100000:2.0:1790946566.642088:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303356672 00000100:00100000:2.0:1790946566.642169:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1790946566.642183:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be0f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1877943303356672:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1790946566.642450:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1790946566.642624:0:6678:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790946566.642784:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be133b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303356672:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790946566.642968:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be0f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1877943303356672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 787us (1632us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946566.642978:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000040:00080000:2.0:1790946566.880096:0:12624:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790946566.880105:0:12624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790946566.880146:0:12624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1790946566.880152:0:12624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1790946566.960788:0:11687:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790946566.960797:0:11687:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790946566.960836:0:11687:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1790946566.960842:0:11687:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790946566.960953:0:11687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be132680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11687:1877943303356800:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790946566.961047:0:11687:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146884526c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790946566.963905:0:11687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be132680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11687:1877943303356800:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790946566.964913:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946566.964989:0:11315:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286595968 00000100:00100000:2.0:1790946566.965003:0:11315:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286595968 00000100:00100000:2.0:1790946566.965109:0:11315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 232 00000100:00100000:2.0:1790946566.965120:0:11315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5eb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+26:11633:x1877943286595968:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1790946566.965152:0:11315:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1790946566.965280:0:11315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5eb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+26:11633:x1877943286595968:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 161us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946566.965288:0:11315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 232 00000100:00100000:3.0:1790946566.967708:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946566.967921:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286596224 00000100:00100000:0.0:1790946566.967931:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286596224 00000100:00100000:0.0:1790946566.968089:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 233 00000100:00100000:0.0:1790946566.968099:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5eb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+26:11633:x1877943286596224:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790946566.968121:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946566.968173:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef93272c11 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0d009 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946566.968274:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272c18 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946566.968288:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272c18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946566.968301:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272c18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790946566.968311:0:5835:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1790946566.968431:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933a00/0x16e41aef93272c11 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d009 expref: 29 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946566.968447:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272c18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d009 expref: 28 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946566.968455:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9146836df400) 00010000:00010000:0.0:1790946566.968458:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790946566.968468:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b1933800, rc 0) 00000100:00100000:0.0:1790946566.968517:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5eb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+28:11633:x1877943286596224:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 420us (817us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1790946566.968523:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 233 00000100:00100000:1.0:1790946566.972641:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946566.972711:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286596480 00000100:00100000:3.0:1790946566.972721:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286596480 00000100:00100000:3.0:1790946566.972772:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 234 00000100:00100000:3.0:1790946566.972781:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be849180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+28:11633:x1877943286596480:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1790946566.972856:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7400/0x16e41aef93272c26 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946566.972874:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7400/0x16e41aef93272c26 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946566.972885:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7400/0x16e41aef93272c26 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946566.973160:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7400/0x16e41aef93272c26 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946566.973168:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7400/0x16e41aef93272c26 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946566.973174:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7400/0x16e41aef93272c26 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946566.973181:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146be9f7400 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946566.973185:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7400/0x16e41aef93272c26 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946566.973192:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7400/0x16e41aef93272c26 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946566.973507:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9146836df400) 00010000:00010000:3.0:1790946566.973517:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790946566.973523:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7400/0x16e41aef93272c26 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946566.973530:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7400/0x16e41aef93272c26 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946566.973743:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be849180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+29:11633:x1877943286596480:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 961us (1107us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1790946566.973753:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 234 00000040:00080000:3.0:1790946566.973869:0:11687:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790946566.974161:0:11687:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1790946566.974512:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946566.974538:0:5820:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286596608 00000100:00100000:0.0:1790946566.974545:0:5820:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286596608 00000100:00100000:0.0:1790946566.974611:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:0.0:1790946566.974620:0:5820:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be0f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+29:2362:x1877943286596608:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790946566.974632:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790946566.974649:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933800/0x16e41aef93272c18 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d009 expref: 29 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946566.974663:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9146836df400) 00010000:00010000:0.0:1790946566.974669:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790946566.974704:0:5820:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be0f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+28:2362:x1877943286596608:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 85us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946566.974712:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 18 00000040:00080000:3.0:1790946566.976139:0:11687:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1790946566.976156:0:11687:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790946566.978732:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946566.978821:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286596864 00000100:00100000:2.0:1790946566.978831:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286596864 00000100:00100000:2.0:1790946566.978904:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 64 00000100:00100000:2.0:1790946566.978912:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be0f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+28:11633:x1877943286596864:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790946566.979136:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be0f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+29:11633:x1877943286596864:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 223us (412us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1790946566.979144:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 64 00010000:00010000:0.0:1790946567.473127:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946568.498330:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790946568.709982:0:12676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790946568.709991:0:12676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790946568.710051:0:12676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1790946568.710057:0:12676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:0.0:1790946568.755413:0:6700:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:0.0:1790946568.755430:0:6700:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:0.0:1790946568.755436:0:6700:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:0.0:1790946568.917655:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946568.922925:0:11315:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286597120 00000100:00100000:2.0:1790946568.922940:0:11315:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286597120 00000100:00100000:3.0:1790946568.923231:0:11315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 235 00000100:00100000:3.0:1790946568.923244:0:11315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be0f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+29:11653:x1877943286597120:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1790946568.923267:0:11315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946568.923327:0:11315:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7400/0x16e41aef93272c2d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0d010 expref: -99 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946568.923453:0:11315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7e00/0x16e41aef93272c34 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946568.923469:0:11315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7e00/0x16e41aef93272c34 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946568.923480:0:11315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7e00/0x16e41aef93272c34 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11315 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790946568.923516:0:11315:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1790946568.923671:0:11315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7400/0x16e41aef93272c2d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d010 expref: 32 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946568.923691:0:11315:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7e00/0x16e41aef93272c34 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d010 expref: 31 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946568.923701:0:11315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9146836df400) 00010000:00010000:3.0:1790946568.923704:0:11315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1790946568.923708:0:11315:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146be9f7e00, rc 0) 00000100:00100000:3.0:1790946568.923788:0:11315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be0f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+31:11653:x1877943286597120:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 537us (6130us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1790946568.923797:0:11315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 235 00000100:00080000:0.0:1790946568.924552:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790946568.934694:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946568.934753:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946568.934788:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286597248 00000100:00100000:3.0:1790946568.934798:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286597248 00000100:00100000:3.0:1790946568.934851:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 300 00000100:00100000:3.0:1790946568.934860:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:2361:x1877943286597248:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790946568.934936:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:2361:x1877943286597248:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 76us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946568.934944:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 300 00000100:00100000:1.0:1790946568.935134:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946568.935163:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286597504 00000100:00100000:1.0:1790946568.935167:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946568.935170:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286597504 00000100:00100000:1.0:1790946568.935226:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946568.935243:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286597376 00000100:00100000:0.0:1790946568.935248:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286597376 00000100:00100000:1.0:1790946568.935256:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286597632 00000100:00100000:1.0:1790946568.935262:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286597632 00000100:00100000:0.0:1790946568.935277:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 91 00000100:00100000:0.0:1790946568.935287:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be84a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+7:2361:x1877943286597504:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790946568.935314:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286597760 00000100:00100000:1.0:1790946568.935318:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286597760 00000100:00100000:0.0:1790946568.935331:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be84a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+7:2361:x1877943286597504:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 46us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946568.935339:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 91 00000100:00100000:1.0:1790946568.935345:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 158 00000100:00100000:1.0:1790946568.935354:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146befb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+5:2361:x1877943286597632:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1790946568.935360:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 92 00000100:00100000:0.0:1790946568.935371:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146befb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+5:2361:x1877943286597376:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790946568.935397:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146befb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+5:2361:x1877943286597632:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 43us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946568.935408:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 158 00000100:00100000:0.0:1790946568.935408:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146befb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+5:2361:x1877943286597376:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 37us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946568.935418:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 92 00000100:00100000:1.0:1790946568.935426:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 236 00000100:00100000:1.0:1790946568.935435:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be0c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+31:11653:x1877943286597760:12345-192.168.203.13@tcp:54:lfs.0 00000100:00080000:0.0:1790946568.935442:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790946568.935449:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790946568.935451:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1790946568.935489:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272c42 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946568.935508:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272c42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946568.935522:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272c42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946568.935563:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272c42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946568.935576:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272c42 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946568.935584:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272c42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946568.935590:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180f800 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:1.0:1790946568.935595:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272c42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946568.935618:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272c42 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946568.935631:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9146836df400) 00010000:00010000:1.0:1790946568.935634:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790946568.935639:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272c42 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946568.935645:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93272c42 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946568.935696:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be0c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+31:11653:x1877943286597760:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 262us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946568.935703:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 236 00000100:00100000:0.0:1790946569.068454:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946569.068571:0:12075:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286597888 00000100:00100000:2.0:1790946569.068582:0:12075:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286597888 00000100:00100000:2.0:1790946569.068637:0:12075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 73 00000100:00100000:2.0:1790946569.068647:0:12075:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be0f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+7:2362:x1877943286597888:12345-192.168.203.13@tcp:101:cat.0 00010000:00010000:2.0:1790946569.068664:0:12075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946569.068685:0:12075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5a9b7d2/0x16e41aef93272c49 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0d017 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790946569.068711:0:12075:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6abfad04, atime: 0x6abfad03, ctime: 0x6abfad04, blocks: 0xb 00010000:00010000:2.0:1790946569.068730:0:12075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=354s v=(0 0) 00010000:00010000:2.0:1790946569.068747:0:12075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790946569.068757:0:12075:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5a9b7d2/0x16e41aef93272c49 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d017 expref: 8 pid: 12075 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946569.068776:0:12075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f5a9b7d2/0x16e41aef93272c49 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d017 expref: 8 pid: 12075 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946569.068794:0:12075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914688aee600, rc 0) 00000100:00100000:2.0:1790946569.068859:0:12075:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be0f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+8:2362:x1877943286597888:12345-192.168.203.13@tcp:101:cat.0 Request processed in 213us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946569.068866:0:12075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 73 00000100:00100000:0.0:1790946569.074154:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946569.074502:0:6679:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286598016 00000100:00100000:2.0:1790946569.074514:0:6679:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286598016 00002000:00100000:2.0:1790946569.074588:0:6679:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9146be0f4000 x1877943286598016/t0(0) o3->7eed1f4b-bd5b-4a70-8045-59db065b3dfc@192.168.203.13@tcp:510/0 lens 488/0 e 0 to 0 dl 1790946580 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790946569.074601:0:6679:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9146be0f4000 with x1877943286598016 ext(0->4095) 00002000:00010000:2.0:1790946569.074607:0:6679:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9146be0f4000 00000100:00100000:2.0:1790946569.074638:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:2.0:1790946569.074648:0:6679:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be0f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+8:2364:x1877943286598016:12345-192.168.203.13@tcp:3:cat.0 00000100:00100000:2.0:1790946569.075481:0:6679:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be0f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+8:2364:x1877943286598016:12345-192.168.203.13@tcp:3:cat.0 Request processed in 830us (1332us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1790946569.075490:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 9 00002000:00100000:2.0:1790946569.075499:0:6679:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9146be0f4000 x1877943286598016/t0(0) o3->7eed1f4b-bd5b-4a70-8045-59db065b3dfc@192.168.203.13@tcp:510/0 lens 488/4536 e 0 to 0 dl 1790946580 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790946569.075508:0:6679:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9146be0f4000 with x1877943286598016 ext(0->4095) 00002000:00010000:2.0:1790946569.075525:0:6679:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9146be0f4000 00000100:00100000:3.0:1790946569.200587:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be0f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877943303357056:0@lo:400:kworker.0 00000100:00100000:1.0:1790946569.200625:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be0f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3303:1877943303356928:0@lo:400:kworker.0 00000100:00100000:1.0:1790946569.200696:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946569.200707:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946569.200765:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303356928 00000100:00100000:3.0:1790946569.200772:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303356928 00000100:00100000:3.0:1790946569.200822:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1790946569.200832:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3303:x1877943303356928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946569.200849:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303357056 00000100:00100000:1.0:1790946569.200854:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303357056 00000100:00100000:1.0:1790946569.200888:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1790946569.200896:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5eb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877943303357056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946569.200905:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3303:x1877943303356928:12345-0@lo:400:kworker.0 Request processed in 73us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946569.200914:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1790946569.200945:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5eb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877943303357056:12345-0@lo:400:kworker.0 Request processed in 49us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946569.200953:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1790946569.200976:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be0f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3303:1877943303356928:0@lo:400:kworker.0 00000100:00100000:3.0:1790946569.201016:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be0f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877943303357056:0@lo:400:kworker.0 00000100:00100000:2.0:1790946569.202316:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be0f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303357312:0@lo:400:kworker.0 00000100:00100000:2.0:1790946569.202367:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946569.202433:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790946569.202444:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be0f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1877943303357184:0@lo:400:kworker.0 00000100:00100000:3.0:1790946569.202481:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946569.202488:0:6673:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303357312 00000100:00100000:1.0:1790946569.202496:0:6673:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303357312 00000100:00100000:3.0:1790946569.202515:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303357184 00000100:00100000:3.0:1790946569.202521:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303357184 00000100:00100000:3.0:1790946569.202579:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1790946569.202579:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1790946569.202592:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be132a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303357312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946569.202594:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beef2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1877943303357184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946569.202647:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beef2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1877943303357184:12345-0@lo:400:kworker.0 Request processed in 57us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946569.202654:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1790946569.202693:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be0f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1877943303357184:0@lo:400:kworker.0 00000100:00100000:3.0:1790946569.202732:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1877943303357440:0@lo:400:kworker.0 00000100:00100000:3.0:1790946569.202757:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946569.202784:0:11315:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303357440 00000100:00100000:3.0:1790946569.202787:0:11315:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303357440 00000100:00100000:3.0:1790946569.202811:0:11315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1790946569.202816:0:11315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beef3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877943303357440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946569.202848:0:11315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beef3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877943303357440:12345-0@lo:400:kworker.0 Request processed in 32us (91us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946569.202863:0:11315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1790946569.202888:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1877943303357440:0@lo:400:kworker.0 00000100:00080000:3.0:1790946569.202916:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790946569.202921:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790946569.213503:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be132a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303357312:12345-0@lo:400:kworker.0 Request processed in 10902us (11123us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946569.213520:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1790946569.215104:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1790946569.215115:0:3302:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:2.0:1790946569.215135:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91469829f800, transno 4294967310 00000100:00100000:2.0:1790946569.215166:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be0f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303357312:0@lo:400:kworker.0 00000100:00100000:3.0:1790946569.219649:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303357568:0@lo:400:kworker.0 00000100:00100000:3.0:1790946569.219724:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946569.219830:0:6808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303357568 00000100:00100000:2.0:1790946569.219838:0:6808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303357568 00000100:00100000:2.0:1790946569.219912:0:6808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1790946569.219922:0:6808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beef0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3300:x1877943303357568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946569.219989:0:6808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beef0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3300:x1877943303357568:12345-0@lo:400:kworker.0 Request processed in 67us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946569.219996:0:6808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:3.0:1790946569.220111:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790946569.220246:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303357568:0@lo:400:kworker.0 00010000:00010000:0.0:1790946569.520434:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946569.712744:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146beef0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303357696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790946569.712826:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946569.713009:0:6676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303357696 00000100:00100000:3.0:1790946569.713017:0:6676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303357696 00000100:00100000:2.0:1790946569.713196:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1790946569.713235:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1877943303357696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790946569.713271:0:6678:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790946569.713318:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1877943303357696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946569.713325:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1790946569.713704:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146beef0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303357696:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1790946570.032614:0:11687:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790946570.032623:0:11687:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790946570.032673:0:11687:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1790946570.032681:0:11687:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1790946570.544367:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1790946570.785321:0:5857:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967517 is committed 00000020:00080000:2.0:1790946570.785340:0:5857:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:2.0:1790946570.785352:0:5857:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91468574f780 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1790946570.785357:0:5857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff914682f29d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91468574fcc0 00000020:00080000:2.0:1790946570.785360:0:5857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff914682f29e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9146be087c00 00000001:00080000:2.0:1790946570.785374:0:5857:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000001:00080000:2.0:1790946570.785404:0:5857:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:2.0:1790946570.785412:0:5857:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 6 batchid updated 00000020:00080000:0.0:1790946570.787057:0:5868:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1790946570.787962:0:5868:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:2.0:1790946570.824243:0:7645:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:2.0:1790946570.824259:0:7645:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00010000:00010000:3.0:1790946571.571398:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946571.760407:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be0c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303357824:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790946571.760479:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946571.760620:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303357824 00000100:00100000:1.0:1790946571.760628:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303357824 00000100:00100000:1.0:1790946571.760692:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790946571.760701:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beef3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303357824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790946571.760734:0:6678:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790946571.760780:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beef3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303357824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946571.760786:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790946571.760829:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be0c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303357824:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1790946571.760946:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790946572.593820:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946573.616710:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946573.843923:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946573.844348:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286598144 00000100:00100000:1.0:1790946573.844358:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286598144 00000100:00100000:1.0:1790946573.844424:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 237 00000100:00100000:1.0:1790946573.844436:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beef0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+18:11298:x1877943286598144:12345-192.168.203.13@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1790946573.844552:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beef0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+18:11298:x1877943286598144:12345-192.168.203.13@tcp:60:lhsmtool_posix.0 Request processed in 119us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946573.844559:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 237 00000100:00080000:3.0:1790946573.844590:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790946573.848166:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946573.848315:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286598400 00000100:00100000:2.0:1790946573.848325:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286598400 00000100:00100000:2.0:1790946573.848383:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 65 00000100:00100000:2.0:1790946573.848393:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beee4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+18:11298:x1877943286598400:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790946573.848945:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beee4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+19:11298:x1877943286598400:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 552us (786us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1790946573.848954:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 65 00000100:00100000:0.0:1790946574.049454:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946574.049545:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946574.049582:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946574.049797:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286598656 00000100:00100000:2.0:1790946574.049807:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286598656 00000100:00100000:2.0:1790946574.049864:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286598784 00000100:00100000:2.0:1790946574.049868:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286598784 00000100:00100000:2.0:1790946574.049891:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 95 00000100:00100000:2.0:1790946574.049900:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914688711500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+5:2361:x1877943286598656:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790946574.049973:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914688711500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+5:2361:x1877943286598656:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 72us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946574.049981:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 95 00000100:00100000:2.0:1790946574.049997:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 96 00000100:00100000:2.0:1790946574.050003:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be160a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+7:2361:x1877943286598784:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790946574.050030:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be160a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+7:2361:x1877943286598784:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 27us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946574.050036:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 96 00000100:00080000:2.0:1790946574.050056:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790946574.050072:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790946574.050148:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946574.050319:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286598912 00000100:00100000:0.0:1790946574.050325:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286598912 00000100:00100000:0.0:1790946574.050366:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 162 00000100:00100000:0.0:1790946574.050373:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be160000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+5:2361:x1877943286598912:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790946574.050506:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286598528 00000100:00100000:3.0:1790946574.050511:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286598528 00000100:00100000:3.0:1790946574.050539:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 302 00000100:00100000:3.0:1790946574.050546:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:2361:x1877943286598528:12345-192.168.203.13@tcp:400:kworker.0 00000100:00080000:2.0:1790946574.052616:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790946574.053123:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:2361:x1877943286598528:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 2568us (3734us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946574.053142:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be160000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+5:2361:x1877943286598912:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 2769us (2994us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946574.053148:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 302 00000100:00100000:0.0:1790946574.053151:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 162 00000100:00100000:3.0:1790946574.320484:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790946574.320515:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91468e93d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303358336:0@lo:400:kworker.0 00000100:00100000:1.0:1790946574.320528:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91468e93f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1877943303358208:0@lo:400:kworker.0 00000100:00100000:0.0:1790946574.320594:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be075880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1877943303358464:0@lo:400:kworker.0 00000100:00100000:2.0:1790946574.320614:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91468e93e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877943303358080:0@lo:400:kworker.0 00000100:00100000:1.0:1790946574.324277:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946574.324392:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303358208 00000100:00100000:1.0:1790946574.324401:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303358208 00000100:00100000:1.0:1790946574.324460:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1790946574.324482:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1877943303358208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946574.324550:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1877943303358208:12345-0@lo:400:kworker.0 Request processed in 69us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946574.324557:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1790946574.324603:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91468e93f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1877943303358208:0@lo:400:kworker.0 00000100:00080000:1.0:1790946574.324633:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790946574.325947:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946574.326003:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be0c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3302:1877943303357952:0@lo:400:kworker.0 00000100:00100000:3.0:1790946574.326047:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946574.326601:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303357952 00000100:00100000:3.0:1790946574.326610:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303357952 00000100:00100000:3.0:1790946574.326654:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1790946574.326662:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3302:x1877943303357952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946574.326792:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3302:x1877943303357952:12345-0@lo:400:kworker.0 Request processed in 130us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946574.326800:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1790946574.326854:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be0c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3302:1877943303357952:0@lo:400:kworker.0 00000100:00100000:1.0:1790946574.327314:0:12075:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303358336 00000100:00100000:1.0:1790946574.327320:0:12075:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303358336 00000100:00100000:1.0:1790946574.327378:0:12075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1790946574.327386:0:12075:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beef0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303358336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946574.327431:0:12075:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beef0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303358336:12345-0@lo:400:kworker.0 Request processed in 47us (1489us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946574.327437:0:12075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:3.0:1790946574.327518:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790946574.327546:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91468e93d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303358336:0@lo:400:kworker.0 00000100:00100000:0.0:1790946574.327685:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946574.329477:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303358464 00000100:00100000:1.0:1790946574.329489:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303358464 00000100:00100000:1.0:1790946574.329626:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1790946574.329635:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146875b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877943303358464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946574.329715:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146875b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877943303358464:12345-0@lo:400:kworker.0 Request processed in 81us (2030us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946574.329723:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1790946574.329813:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be075880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1877943303358464:0@lo:400:kworker.0 00000100:00100000:2.0:1790946574.330419:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946574.330532:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303358592:0@lo:400:kworker.0 00000100:00100000:2.0:1790946574.330636:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946574.331385:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303358080 00000100:00100000:0.0:1790946574.331395:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303358080 00000100:00100000:0.0:1790946574.331433:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1790946574.331441:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be132d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877943303358080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946574.331506:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be132d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877943303358080:12345-0@lo:400:kworker.0 Request processed in 55us (1077us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946574.331513:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1790946574.331588:0:6808:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303358592 00000100:00100000:1.0:1790946574.331593:0:6808:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303358592 00000100:00100000:2.0:1790946574.331626:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91468e93e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877943303358080:0@lo:400:kworker.0 00000100:00080000:3.0:1790946574.333826:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790946574.333835:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790946574.334052:0:6808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1790946574.334064:0:6808:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be132680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303358592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946574.334174:0:6808:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be132680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303358592:12345-0@lo:400:kworker.0 Request processed in 113us (3537us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946574.334196:0:6808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1790946574.335863:0:3300:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:2.0:1790946574.335873:0:3300:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9146be160380, transno 4294967323 00000004:00080000:2.0:1790946574.335897:0:3300:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:2.0:1790946574.335922:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303358592:0@lo:400:kworker.0 00010000:00010000:3.0:1790946574.640407:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946574.832414:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790946574.832439:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be133b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303358720:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790946574.832520:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946574.832692:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303358720 00000100:00100000:1.0:1790946574.832701:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303358720 00000100:00100000:1.0:1790946574.832755:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790946574.832764:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be131500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303358720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790946574.832798:0:6678:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790946574.832851:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be131500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303358720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946574.832859:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1790946574.832944:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be133b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303358720:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790946575.664863:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1790946575.912544:0:5857:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:0.0:1790946575.912565:0:5857:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:0.0:1790946575.912578:0:5868:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1790946575.912589:0:5868:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:02000400:0.0:1790946575.925942:0:12881:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 09:09:33 (1790946573) 00010000:00010000:3.0:1790946576.688340:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946576.881962:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790946576.881985:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be133b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303358848:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790946576.882047:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946576.882119:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303358848 00000100:00100000:2.0:1790946576.882127:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303358848 00000100:00100000:2.0:1790946576.882188:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1790946576.882197:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be849500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877943303358848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790946576.882250:0:6678:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790946576.882292:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be849500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877943303358848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946576.882300:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1790946576.882364:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be133b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303358848:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1790946576.882997:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790946577.714077:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946578.295635:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946578.295732:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286599040 00000100:00100000:1.0:1790946578.295747:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286599040 00000100:00100000:1.0:1790946578.295865:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 238 00000100:00100000:1.0:1790946578.295879:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be160380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+5:12317:x1877943286599040:12345-192.168.203.13@tcp:101:lsof.0 00010000:00010000:1.0:1790946578.295908:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946578.295935:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef93272c50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0d01e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946578.296048:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93272c57 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946578.296065:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93272c57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946578.296083:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93272c57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790946578.296135:0:5834:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790946578.296139:0:5834:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790946578.296246:0:5834:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93272c57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946578.296280:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef93272c50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d01e expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946578.296306:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93272c57 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d01e expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946578.296317:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9146836df800) 00010000:00010000:1.0:1790946578.296322:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790946578.296328:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b180f600, rc 0) 00000100:00100000:1.0:1790946578.296687:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be160380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+6:12317:x1877943286599040:12345-192.168.203.13@tcp:101:lsof.0 Request processed in 810us (1066us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946578.296698:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 238 00000100:00080000:3.0:1790946578.296797:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1790946578.736678:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946579.170947:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946579.170997:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946579.171034:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946579.171063:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946579.171097:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946579.171141:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286599680 00000100:00100000:2.0:1790946579.171152:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286599680 00000100:00100000:2.0:1790946579.171240:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286599296 00000100:00100000:2.0:1790946579.171243:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286599296 00000100:00100000:2.0:1790946579.171277:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 166 00000100:00100000:2.0:1790946579.171287:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146becb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+6:2362:x1877943286599680:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1790946579.171382:0:11315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 167 00000100:00100000:2.0:1790946579.171392:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146becb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+6:2362:x1877943286599680:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 105us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946579.171398:0:11315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682eafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+18:2362:x1877943286599296:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790946579.171406:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 166 00000100:00100000:2.0:1790946579.171438:0:12075:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286599424 00000100:00100000:2.0:1790946579.171442:0:12075:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286599424 00000100:00100000:0.0:1790946579.171451:0:11315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682eafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+18:2362:x1877943286599296:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 59us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946579.171470:0:11315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 167 00000100:00100000:2.0:1790946579.171485:0:12075:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286599552 00000100:00100000:2.0:1790946579.171489:0:12075:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286599552 00000100:00100000:3.0:1790946579.171564:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286599168 00000100:00100000:3.0:1790946579.171585:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286599168 00000100:00100000:3.0:1790946579.171616:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 304 00000100:00100000:3.0:1790946579.171623:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:2362:x1877943286599168:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790946579.171654:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:2362:x1877943286599168:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 32us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946579.171661:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 304 00000100:00080000:3.0:1790946579.171695:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790946579.171700:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790946579.171704:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790946579.171986:0:12075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 99 00000100:00100000:2.0:1790946579.171996:0:12075:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be133b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+5:2362:x1877943286599424:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790946579.172029:0:12075:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be133b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+5:2362:x1877943286599424:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 35us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946579.172036:0:12075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 99 00000100:00100000:2.0:1790946579.172048:0:12075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 100 00000100:00100000:2.0:1790946579.172055:0:12075:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682eaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+7:2362:x1877943286599552:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790946579.172094:0:12075:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682eaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+7:2362:x1877943286599552:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 40us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946579.172101:0:12075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 100 00000100:00100000:2.0:1790946579.440928:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bdccad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1877943303359232:0@lo:400:kworker.0 00000100:00100000:3.0:1790946579.440931:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bdcc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877943303359104:0@lo:400:kworker.0 00000100:00100000:2.0:1790946579.441032:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946579.441135:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946579.441135:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303359232 00000100:00100000:2.0:1790946579.441145:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303359232 00000100:00100000:3.0:1790946579.441165:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303359616:0@lo:400:kworker.0 00000100:00100000:3.0:1790946579.441231:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946579.441245:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303359104 00000100:00100000:2.0:1790946579.441250:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303359104 00000100:00100000:2.0:1790946579.441284:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1790946579.441285:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303359616 00000100:00100000:3.0:1790946579.441291:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303359616 00000100:00100000:2.0:1790946579.441298:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1877943303359232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946579.441330:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1790946579.441340:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91469829f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303359616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946579.441370:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1877943303359232:12345-0@lo:400:kworker.0 Request processed in 74us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946579.441380:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1790946579.441398:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91469829f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303359616:12345-0@lo:400:kworker.0 Request processed in 58us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946579.441408:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1790946579.441409:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1790946579.441420:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be0c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877943303359104:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1790946579.441435:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790946579.441443:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790946579.441474:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be0c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877943303359104:12345-0@lo:400:kworker.0 Request processed in 55us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946579.441483:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1790946579.441506:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bdcc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877943303359104:0@lo:400:kworker.0 00000100:00100000:3.0:1790946579.441524:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303359616:0@lo:400:kworker.0 00000100:00100000:2.0:1790946579.441533:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bdccad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1877943303359232:0@lo:400:kworker.0 00000100:00100000:0.0:1790946579.441645:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3303:1877943303358976:0@lo:400:kworker.0 00000100:00100000:0.0:1790946579.441684:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946579.441717:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1877943303359488:0@lo:400:kworker.0 00000100:00100000:0.0:1790946579.441742:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946579.441762:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790946579.441769:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bdcc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303359360:0@lo:400:kworker.0 00000100:00100000:0.0:1790946579.441792:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946579.441821:0:5836:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303359488 00000100:00100000:0.0:1790946579.441825:0:5836:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303359488 00000100:00100000:0.0:1790946579.441855:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1790946579.441861:0:5836:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be075880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877943303359488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946579.441897:0:5836:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be075880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1877943303359488:12345-0@lo:400:kworker.0 Request processed in 36us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946579.441903:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1790946579.441929:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1877943303359488:0@lo:400:kworker.0 00000100:00100000:0.0:1790946579.441959:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303359360 00000100:00100000:0.0:1790946579.441963:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303359360 00000100:00100000:0.0:1790946579.442014:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1790946579.442021:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be127480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1877943303359360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946579.442061:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be127480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1877943303359360:12345-0@lo:400:kworker.0 Request processed in 40us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946579.442067:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1790946579.442092:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bdcc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303359360:0@lo:400:kworker.0 00000100:00080000:0.0:1790946579.442114:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790946579.442118:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790946579.442218:0:5827:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303358976 00000100:00100000:2.0:1790946579.442223:0:5827:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303358976 00000100:00100000:2.0:1790946579.442261:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1790946579.442269:0:5827:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3303:x1877943303358976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946579.442311:0:5827:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3303:x1877943303358976:12345-0@lo:400:kworker.0 Request processed in 43us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946579.442325:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1790946579.442364:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3303:1877943303358976:0@lo:400:kworker.0 00010000:00010000:3.0:1790946579.760743:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946579.769062:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946579.769153:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286599936 00000100:00100000:0.0:1790946579.769168:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286599936 00000100:00100000:0.0:1790946579.769280:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 66 00000100:00100000:0.0:1790946579.769292:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+18:12318:x1877943286599936:12345-192.168.203.13@tcp:35:umount.0 00000100:00100000:0.0:1790946579.771007:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+19:12318:x1877943286599936:12345-192.168.203.13@tcp:35:umount.0 Request processed in 1707us (1951us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1790946579.771022:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 66 00000100:00100000:0.0:1790946579.779964:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946579.784557:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286600192 00000100:00100000:2.0:1790946579.784582:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286600192 00000100:00100000:2.0:1790946579.784903:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 67 00000100:00100000:2.0:1790946579.784925:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be125180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+19:12318:x1877943286600192:12345-192.168.203.13@tcp:35:umount.0 00000100:00100000:2.0:1790946579.785492:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be125180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+20:12318:x1877943286600192:12345-192.168.203.13@tcp:35:umount.0 Request processed in 565us (5538us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1790946579.785503:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 67 00000100:00100000:2.0:1790946579.789613:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946579.789942:0:5838:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286600448 00000100:00100000:0.0:1790946579.789959:0:5838:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286600448 00000100:00100000:0.0:1790946579.790334:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 68 00000100:00100000:0.0:1790946579.790355:0:5838:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91469119d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+20:12318:x1877943286600448:12345-192.168.203.13@tcp:35:umount.0 00000100:00100000:0.0:1790946579.790736:0:5838:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91469119d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+21:12318:x1877943286600448:12345-192.168.203.13@tcp:35:umount.0 Request processed in 392us (1627us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1790946579.790745:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 68 00000100:00100000:3.0:1790946579.793679:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946579.793875:0:5837:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286600704 00000100:00100000:2.0:1790946579.793888:0:5837:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286600704 00000100:00100000:2.0:1790946579.793952:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 69 00000100:00100000:2.0:1790946579.793964:0:5837:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bdcc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+21:12318:x1877943286600704:12345-192.168.203.13@tcp:35:umount.0 00000100:00100000:2.0:1790946579.794834:0:5837:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bdcc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+22:12318:x1877943286600704:12345-192.168.203.13@tcp:35:umount.0 Request processed in 868us (1165us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1790946579.794845:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 69 00000100:00100000:0.0:1790946579.803712:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946579.803758:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946579.803792:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946579.803913:0:5820:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286600832 00000100:00100000:1.0:1790946579.803928:0:5820:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286600832 00000100:00100000:1.0:1790946579.803990:0:5820:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286600960 00000100:00100000:1.0:1790946579.803994:0:5820:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286600960 00000100:00100000:1.0:1790946579.804007:0:5820:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286601088 00000100:00100000:1.0:1790946579.804010:0:5820:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286601088 00000100:00100000:1.0:1790946579.804029:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:1.0:1790946579.804039:0:5820:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be125180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec4ece38-7293-498c-8428-4d215a1f0fd0+15:2361:x1877943286600832:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790946579.804060:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790946579.804084:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff914680031600/0x16e41aef93271cdd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cbb0 expref: 15 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946579.804112:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790946579.804300:0:5820:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be125180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec4ece38-7293-498c-8428-4d215a1f0fd0+14:2361:x1877943286600832:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 261us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946579.804316:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:1.0:1790946579.804338:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:1.0:1790946579.804345:0:5820:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be125880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec4ece38-7293-498c-8428-4d215a1f0fd0+13:2362:x1877943286600960:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790946579.804354:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790946579.804363:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9146c20cbc00/0x16e41aef93271ef1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc7b expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946579.804374:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790946579.804407:0:5820:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be125880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec4ece38-7293-498c-8428-4d215a1f0fd0+12:2362:x1877943286600960:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 62us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946579.804413:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:1.0:1790946579.804425:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:1.0:1790946579.804431:0:5820:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be125f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec4ece38-7293-498c-8428-4d215a1f0fd0+11:2363:x1877943286601088:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790946579.804439:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790946579.804447:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff914688aef600/0x16e41aef93271c43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cb78 expref: 11 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946579.805578:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790946579.805654:0:5820:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be125f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec4ece38-7293-498c-8428-4d215a1f0fd0+10:2363:x1877943286601088:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 1216us (1854us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946579.805665:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:0.0:1790946579.815942:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946579.816150:0:12075:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286601472 00000100:00100000:2.0:1790946579.816165:0:12075:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286601472 00000100:00100000:2.0:1790946579.816263:0:12075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 74 00000100:00100000:2.0:1790946579.816274:0:12075:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be125500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+7:2360:x1877943286601472:12345-192.168.203.13@tcp:9:umount.0 00000020:00000080:2.0:1790946579.816328:0:12075:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x16e41aef9327221d 00000020:00010000:2.0:1790946579.816344:0:12075:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9146beb37800: total 0 00000100:00080000:2.0:1790946579.816369:0:12075:0:(import.c:65:import_set_state_nolock()) ffff9146beb31000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790946579.816427:0:12075:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000020:00010000:1.0:1790946579.817646:0:5823:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9146beb37800: total 0 00010000:00010000:1.0:1790946579.817700:0:5823:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9146beb37800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1790946579.817770:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000892c7a1b/0x16e41aef932725b9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce50 expref: 5 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946579.817837:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5a9b7d2/0x16e41aef93272c49 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d017 expref: 4 pid: 12075 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946579.817854:0:5823:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9146beb37800, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1790946579.817867:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946579.817869:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946579.817870:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946579.818304:0:12075:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be125500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+2:2360:x1877943286601472:12345-192.168.203.13@tcp:9:umount.0 Request processed in 2028us (2384us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946579.818321:0:12075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 74 00000100:00100000:2.0:1790946579.829726:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946579.829822:0:6674:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286601600 00000100:00100000:0.0:1790946579.829835:0:6674:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286601600 00000100:00100000:0.0:1790946579.829929:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 75 00000100:00100000:0.0:1790946579.829940:0:6674:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+5:2360:x1877943286601600:12345-192.168.203.13@tcp:9:umount.0 00000020:00000080:0.0:1790946579.829987:0:6674:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x16e41aef93271fb5 00000100:00080000:0.0:1790946579.829998:0:6674:0:(import.c:65:import_set_state_nolock()) ffff914684946000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790946579.830066:0:6674:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:1.0:1790946579.830261:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946579.830651:0:6674:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+2:2360:x1877943286601600:12345-192.168.203.13@tcp:9:umount.0 Request processed in 711us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946579.830661:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 75 00000100:00100000:3.0:1790946579.835745:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946579.835991:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286602624 00000100:00100000:2.0:1790946579.836004:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286602624 00000100:00100000:2.0:1790946579.836090:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 239 00000100:00100000:2.0:1790946579.836102:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bdccad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+22:2360:x1877943286602624:12345-192.168.203.13@tcp:39:umount.0 00000020:00000080:2.0:1790946579.836159:0:5835:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x16e41aef93271c51 00000020:00010000:2.0:1790946579.836183:0:5835:0:(genops.c:1920:obd_stale_export_put()) Put export ffff914587bbc800: total 0 00000100:00080000:2.0:1790946579.836189:0:5835:0:(import.c:65:import_set_state_nolock()) ffff9146bed89800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790946579.836280:0:5835:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:1.0:1790946579.836557:0:5823:0:(genops.c:1906:obd_stale_export_get()) Get export ffff914587bbc800: total 0 00010000:00010000:1.0:1790946579.836564:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946579.836631:0:5823:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff914587bbc800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1790946579.836675:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9146a0a5e900) 00010000:00010000:1.0:1790946579.836680:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790946579.836691:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee200/0x16e41aef93271f37 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc90 expref: 21 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946579.836719:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff914686750d00) 00010000:00010000:1.0:1790946579.836722:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790946579.836727:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7c00/0x16e41aef93272908 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cf3e expref: 20 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946579.836740:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff914686750d00) 00010000:00010000:1.0:1790946579.836743:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1790946579.836747:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef93272629 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce6c expref: 20 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946579.836781:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9146836df700) 00010000:00010000:1.0:1790946579.836805:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790946579.836812:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a800/0x16e41aef9327257a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce3b expref: 19 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946579.836841:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9146836df400) 00010000:00010000:1.0:1790946579.836845:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790946579.836850:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef93272b2a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cfca expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946579.836867:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9146836df800) 00010000:00010000:1.0:1790946579.836871:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790946579.836875:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a200/0x16e41aef9327260d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce65 expref: 18 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946579.836890:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91469e29d100) 00010000:00010000:1.0:1790946579.836893:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790946579.836896:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146c20cac00/0x16e41aef93272278 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cd77 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946579.836910:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9146836dfd00) 00010000:00010000:1.0:1790946579.836912:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790946579.836916:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a000/0x16e41aef93271f1b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc89 expref: 14 pid: 6803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946579.836946:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9146836df700) 00010000:00010000:1.0:1790946579.836949:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1790946579.836954:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef932725a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce49 expref: 13 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946579.836959:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bdccad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7eed1f4b-bd5b-4a70-8045-59db065b3dfc+13:2360:x1877943286602624:12345-192.168.203.13@tcp:39:umount.0 Request processed in 856us (1226us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1790946579.836973:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 239 00010000:00010000:1.0:1790946579.836998:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9146836df400) 00010000:00010000:1.0:1790946579.837001:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790946579.837007:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932800/0x16e41aef93272c0a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d002 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946579.837285:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91469e29d100) 00010000:00010000:1.0:1790946579.837289:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1790946579.837294:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f000/0x16e41aef93271f8b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cca5 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946579.837316:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9146836df400) 00010000:00010000:1.0:1790946579.837320:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1790946579.837324:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7e00/0x16e41aef93272c34 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d010 expref: 9 pid: 11315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946579.837358:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9146836df700) 00010000:00010000:1.0:1790946579.837360:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790946579.837364:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032be00/0x16e41aef9327249a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0ce03 expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946579.837376:0:5823:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff914587bbc800, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1790946579.837390:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946579.837392:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946579.837394:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946579.952919:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146bee96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303359744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790946579.953037:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946579.953104:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303359744 00000100:00100000:2.0:1790946579.953115:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303359744 00000100:00100000:2.0:1790946579.953190:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1790946579.953221:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bdcc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1877943303359744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790946579.953269:0:6678:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790946579.953331:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bdcc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1877943303359744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946579.953338:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1790946579.953511:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146bee96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303359744:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1790946580.274539:0:11687:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790946580.274551:0:11687:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790946580.275716:0:11687:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1790946580.275931:0:11687:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1790946580.784615:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1790946581.043656:0:5857:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:0.0:1790946581.043684:0:5857:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7eed1f4b-bd5b-4a70-8045-59db065b3dfc 00000001:00080000:0.0:1790946581.043690:0:5857:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:0.0:1790946581.043699:0:5857:0:(genops.c:885:class_export_put()) final put ffff914587bbc800/7eed1f4b-bd5b-4a70-8045-59db065b3dfc 00000020:00000080:1.0:1790946581.043960:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff914587bbc800/7eed1f4b-bd5b-4a70-8045-59db065b3dfc for lustre-MDT0000 00000020:00000080:1.0:1790946581.044602:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9146bed89800 for lustre-MDT0000 00000001:00100000:3.0:1790946581.045148:0:7645:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7eed1f4b-bd5b-4a70-8045-59db065b3dfc 00000020:00000080:3.0:1790946581.045155:0:7645:0:(genops.c:885:class_export_put()) final put ffff9146beb37800/7eed1f4b-bd5b-4a70-8045-59db065b3dfc 00000020:00000080:1.0:1790946581.045285:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9146beb37800/7eed1f4b-bd5b-4a70-8045-59db065b3dfc for lustre-OST0001 00000020:00000080:1.0:1790946581.045338:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9146beb31000 for lustre-OST0001 00000100:00100000:1.0:1790946581.421726:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946581.421783:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946581.421825:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946581.421867:0:5820:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286602752 00000100:00100000:1.0:1790946581.421879:0:5820:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286602752 00000100:00100000:1.0:1790946581.421943:0:5820:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286602880 00000100:00100000:1.0:1790946581.421947:0:5820:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286602880 00000100:00100000:1.0:1790946581.421960:0:5820:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286603008 00000100:00100000:1.0:1790946581.421963:0:5820:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286603008 00000100:00100000:1.0:1790946581.421981:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00100000:1.0:1790946581.421993:0:5820:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec4ece38-7293-498c-8428-4d215a1f0fd0+12:2364:x1877943286602752:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790946581.422017:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790946581.422051:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff914680030a00/0x16e41aef93271d23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cbc5 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946581.422075:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790946581.422145:0:5820:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec4ece38-7293-498c-8428-4d215a1f0fd0+11:2364:x1877943286602752:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 153us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946581.422154:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00100000:1.0:1790946581.422175:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 23 00000100:00100000:1.0:1790946581.422182:0:5820:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468e93e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec4ece38-7293-498c-8428-4d215a1f0fd0+10:2363:x1877943286602880:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790946581.422193:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790946581.422266:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff914680031a00/0x16e41aef93271d2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cbef expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946581.422279:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790946581.422321:0:5820:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468e93e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec4ece38-7293-498c-8428-4d215a1f0fd0+9:2363:x1877943286602880:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 140us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946581.422328:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 23 00000100:00100000:1.0:1790946581.422342:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00100000:1.0:1790946581.422348:0:5820:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914685713c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec4ece38-7293-498c-8428-4d215a1f0fd0+8:2364:x1877943286603008:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790946581.422360:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790946581.422369:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff914680031200/0x16e41aef93271eea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cc74 expref: 8 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946581.422380:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790946581.422399:0:5820:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914685713c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec4ece38-7293-498c-8428-4d215a1f0fd0+7:2364:x1877943286603008:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 51us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946581.422405:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00100000:3.0:1790946581.423724:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946581.424016:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286603264 00000100:00100000:1.0:1790946581.424029:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286603264 00000100:00100000:1.0:1790946581.424113:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 240 00000100:00100000:1.0:1790946581.424125:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be0f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+6:2360:x1877943286603264:12345-192.168.203.13@tcp:39:umount.0 00000020:00000080:1.0:1790946581.424176:0:6803:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x16e41aef93271d38 00000100:00080000:0.0:1790946581.424186:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:1.0:1790946581.424188:0:6803:0:(genops.c:1920:obd_stale_export_put()) Put export ffff914684984800: total 0 00000100:00080000:1.0:1790946581.424196:0:6803:0:(import.c:65:import_set_state_nolock()) ffff914684982800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790946581.424262:0:6803:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:1.0:1790946581.424780:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be0f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afc1277-e08f-4ee9-9b29-b05bfc41dd4e+5:2360:x1877943286603264:12345-192.168.203.13@tcp:39:umount.0 Request processed in 656us (1064us total) trans 4294967527 rc 0/0 00000100:00100000:1.0:1790946581.424789:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 240 00000020:00010000:3.0:1790946581.427394:0:5823:0:(genops.c:1906:obd_stale_export_get()) Get export ffff914684984800: total 0 00010000:00010000:3.0:1790946581.427477:0:5823:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff914684984800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1790946581.427523:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9146836df800) 00010000:00010000:3.0:1790946581.427528:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790946581.427544:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f600/0x16e41aef93272c57 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d01e expref: 4 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946581.427577:0:5823:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff914684984800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1790946581.427589:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946581.427592:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946581.427593:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946581.448419:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946581.448658:0:5828:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286603520 00000100:00100000:3.0:1790946581.448671:0:5828:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286603520 00000100:00100000:3.0:1790946581.448745:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 306 00000100:00100000:3.0:1790946581.448757:0:5828:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec4ece38-7293-498c-8428-4d215a1f0fd0+7:2360:x1877943286603520:12345-192.168.203.13@tcp:251:umount.0 00000020:00000080:3.0:1790946581.448823:0:5828:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x16e41aef93271c2e 00000020:00010000:3.0:1790946581.448851:0:5828:0:(genops.c:1920:obd_stale_export_put()) Put export ffff914587bbb000: total 0 00000100:00080000:3.0:1790946581.448858:0:5828:0:(import.c:65:import_set_state_nolock()) ffff914587bba800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1790946581.448957:0:5828:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec4ece38-7293-498c-8428-4d215a1f0fd0+3:2360:x1877943286603520:12345-192.168.203.13@tcp:251:umount.0 Request processed in 201us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946581.448966:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 306 00000020:00010000:1.0:1790946581.449578:0:5822:0:(genops.c:1906:obd_stale_export_get()) Get export ffff914587bbb000: total 0 00010000:00010000:1.0:1790946581.449585:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946581.449646:0:5822:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff914587bbb000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1790946581.449699:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff914680030c00/0x16e41aef93271ce4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0cbb7 expref: 2 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946581.449719:0:5822:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff914587bbb000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1790946581.449730:0:5822:0:(genops.c:885:class_export_put()) final put ffff914587bbb000/ec4ece38-7293-498c-8428-4d215a1f0fd0 00010000:00010000:1.0:1790946581.449744:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946581.449746:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946581.449748:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1790946581.449795:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff914587bbb000/ec4ece38-7293-498c-8428-4d215a1f0fd0 for MGS 00000020:00000080:0.0:1790946581.449844:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff914587bba800 for MGS 00010000:00010000:3.0:1790946581.808669:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946582.007964:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790946582.007996:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91468e93e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303359872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790946582.008112:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946582.008214:0:6678:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303359872 00000100:00100000:1.0:1790946582.008224:0:6678:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303359872 00000100:00100000:1.0:1790946582.008286:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1790946582.008297:0:6678:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468e93d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877943303359872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790946582.008343:0:6678:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790946582.008393:0:6678:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468e93d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877943303359872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946582.008400:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1790946582.008473:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91468e93e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303359872:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1790946582.008940:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790946582.832472:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1790946583.197134:0:13081:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1790946583.227557:0:13081:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1790946583.227629:0:13081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146b180ea00/0x16e41aef93271cb3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271cba expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946583.227649:0:13081:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146b180ea00/0x16e41aef93271cb3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93271cba expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946583.227656:0:13081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146b180ea00/0x16e41aef93271cb3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x16e41aef93271cba expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946583.227685:0:13081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff9146b180ea00/0x16e41aef93271cb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x16e41aef93271cba expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946583.227723:0:13081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1790946583.227730:0:13081:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1790946583.227763:0:13081:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790946583.227769:0:13081:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1790946583.227776:0:13081:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1790946583.227809:0:13081:0:(import.c:65:import_set_state_nolock()) ffff914684fc3000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1790946583.227996:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790946583.228006:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9146b180ea00/0x16e41aef93271cb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x16e41aef93271cba expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946583.228014:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180ea00 already unused, calling callback (ffffffffc1d96c20) 10000000:00010000:0.0:1790946583.228019:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9146b180ea00/0x16e41aef93271cb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x16e41aef93271cba expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946583.228030:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9146b180ea00/0x16e41aef93271cb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x16e41aef93271cba expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790946583.228048:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9146b180ea00/0x16e41aef93271cb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x16e41aef93271cba expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790946583.228055:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790946583.228057:0:5823:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1790946583.228060:0:5823:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1790946583.228092:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9146b180ea00/0x16e41aef93271cb3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x16e41aef93271cba expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946583.228099:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790946583.228130:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9146b180ea00/0x16e41aef93271cb3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x16e41aef93271cba expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946583.228138:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9146b180ea00/0x16e41aef93271cb3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x16e41aef93271cba expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946583.228153:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946583.228155:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946583.228157:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946583.228167:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790946583.228190:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be126680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3302:1877943303360128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790946583.228310:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946583.228389:0:5820:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303360128 00000100:00100000:0.0:1790946583.228397:0:5820:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303360128 00000100:00100000:0.0:1790946583.228466:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790946583.228487:0:5820:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be126a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3302:x1877943303360128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790946583.228504:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790946583.228521:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9146a032ba00/0x16e41aef93271cba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x16e41aef93271cb3 expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946583.228545:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790946583.228586:0:5820:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be126a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+18:3302:x1877943303360128:12345-0@lo:103:ldlm_bl.0 Request processed in 112us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946583.228595:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790946583.228642:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be126680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3302:1877943303360128:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790946583.229100:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91468e93e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1877943303360000:0@lo:39:umount.0 00000100:00100000:3.0:1790946583.229147:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946583.231161:0:5834:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303360000 00000100:00100000:0.0:1790946583.231183:0:5834:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303360000 00000100:00100000:1.0:1790946583.231932:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1790946583.231945:0:5834:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be0f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1877943303360000:12345-0@lo:39:umount.0 00000020:00000080:1.0:1790946583.231986:0:5834:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x16e41aef93271a3d 00000100:00080000:1.0:1790946583.231997:0:5834:0:(import.c:65:import_set_state_nolock()) ffff914684fc1800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1790946583.232124:0:5834:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be0f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3299:x1877943303360000:12345-0@lo:39:umount.0 Request processed in 181us (2976us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946583.232131:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000020:00000080:1.0:1790946583.232144:0:5834:0:(genops.c:885:class_export_put()) final put ffff914684fc3800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1790946583.232378:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff914684fc3800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1790946583.232448:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff914684fc1800 for lustre-MDT0000 00010000:00010000:2.0:1790946583.232462:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790946583.232627:0:3299:0:(import.c:65:import_set_state_nolock()) ffff914684fc3000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1790946583.232794:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91468e93e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1877943303360000:0@lo:39:umount.0 00000100:00080000:1.0:1790946583.232910:0:13081:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790946583.232914:0:13081:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1790946583.232920:0:13081:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1790946583.236050:0:13081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff914680030000/0x16e41aef93271cc1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271cc8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946583.239068:0:13081:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff914680030000/0x16e41aef93271cc1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93271cc8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946583.239353:0:13081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff914680030000/0x16e41aef93271cc1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x16e41aef93271cc8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946583.239380:0:13081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff914680030000/0x16e41aef93271cc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x16e41aef93271cc8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946583.239408:0:13081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790946583.239416:0:13081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff914680030600/0x16e41aef93271be8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271bef expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946583.239423:0:13081:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff914680030600/0x16e41aef93271be8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93271bef expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946583.239442:0:13081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff914680030600/0x16e41aef93271be8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x16e41aef93271bef expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946583.239449:0:13081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff914680030600/0x16e41aef93271be8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x16e41aef93271bef expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946583.239466:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790946583.239473:0:13081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790946583.239482:0:13081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146b180e200/0x16e41aef93271edc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271ee3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946583.239491:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff914680030000/0x16e41aef93271cc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x16e41aef93271cc8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946583.239494:0:13081:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146b180e200/0x16e41aef93271edc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93271ee3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946583.239522:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914680030000 already unused, calling callback (ffffffffc1d96c20) 00010000:00010000:1.0:1790946583.239523:0:13081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146b180e200/0x16e41aef93271edc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x16e41aef93271ee3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790946583.239532:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff914680030000/0x16e41aef93271cc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x16e41aef93271cc8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946583.239538:0:13081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff9146b180e200/0x16e41aef93271edc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x16e41aef93271ee3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946583.239552:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff914680030000/0x16e41aef93271cc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x16e41aef93271cc8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790946583.239581:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff914680030000/0x16e41aef93271cc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x16e41aef93271cc8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946583.239590:0:13081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1790946583.239591:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790946583.239602:0:5823:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1790946583.239656:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff914680030000/0x16e41aef93271cc1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x16e41aef93271cc8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946583.239665:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790946583.239727:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff914680030000/0x16e41aef93271cc1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x16e41aef93271cc8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946583.239755:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff914680030000/0x16e41aef93271cc1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x16e41aef93271cc8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946583.239780:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790946583.239783:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff914680030600/0x16e41aef93271be8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x16e41aef93271bef expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946583.239790:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914680030600 already unused, calling callback (ffffffffc1d96c20) 10000000:00010000:0.0:1790946583.239793:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff914680030600/0x16e41aef93271be8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x16e41aef93271bef expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946583.239801:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff914680030600/0x16e41aef93271be8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x16e41aef93271bef expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790946583.239811:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff914680030600/0x16e41aef93271be8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x16e41aef93271bef expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790946583.239817:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1790946583.239820:0:5823:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1790946583.239824:0:5823:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1790946583.239843:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff914680030600/0x16e41aef93271be8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x16e41aef93271bef expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946583.239850:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790946583.239857:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff914680030600/0x16e41aef93271be8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x16e41aef93271bef expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946583.239863:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff914680030600/0x16e41aef93271be8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x16e41aef93271bef expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946583.239888:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790946583.239892:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9146b180e200/0x16e41aef93271edc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x16e41aef93271ee3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946583.239897:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180e200 already unused, calling callback (ffffffffc1d96c20) 10000000:00010000:0.0:1790946583.239901:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9146b180e200/0x16e41aef93271edc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x16e41aef93271ee3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946583.239907:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9146b180e200/0x16e41aef93271edc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x16e41aef93271ee3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790946583.239914:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9146b180e200/0x16e41aef93271edc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x16e41aef93271ee3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790946583.239920:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1790946583.239922:0:5823:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1790946583.239936:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9146b180e200/0x16e41aef93271edc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x16e41aef93271ee3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946583.239942:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790946583.239961:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9146b180e200/0x16e41aef93271edc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x16e41aef93271ee3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946583.239967:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9146b180e200/0x16e41aef93271edc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x16e41aef93271ee3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946583.239978:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946583.239979:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946583.239982:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946583.240015:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3301:1877943303360384:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790946583.240109:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946583.240176:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790946583.240182:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be126680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3301:1877943303360256:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790946583.240239:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946583.240269:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790946583.240278:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be125880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3303:1877943303360512:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790946583.240303:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946583.240334:0:5819:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303360384 00000100:00100000:0.0:1790946583.240343:0:5819:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303360384 00000100:00100000:0.0:1790946583.240390:0:5819:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303360256 00000100:00100000:0.0:1790946583.240393:0:5819:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303360256 00000100:00100000:0.0:1790946583.240406:0:5819:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303360512 00000100:00100000:0.0:1790946583.240408:0:5819:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303360512 00000100:00100000:0.0:1790946583.240425:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790946583.240446:0:5819:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be125f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+20:3301:x1877943303360384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790946583.240462:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790946583.240481:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff914688aefe00/0x16e41aef93271bef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x16e41aef93271be8 expref: 20 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790946583.240492:0:13081:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1790946583.240503:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790946583.240511:0:13081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff914680030800/0x16e41aef9327199c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef932719a3 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946583.240523:0:13081:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff914680030800/0x16e41aef9327199c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef932719a3 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946583.240531:0:13081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff914680030800/0x16e41aef9327199c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x16e41aef932719a3 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946583.240539:0:13081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff914680030800/0x16e41aef9327199c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x16e41aef932719a3 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946583.240548:0:5819:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be125f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+19:3301:x1877943303360384:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946583.240559:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1790946583.240562:0:13081:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1790946583.240568:0:13081:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1790946583.240575:0:13081:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000100:00100000:0.0:1790946583.240587:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790946583.240598:0:5819:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be849c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+18:3301:x1877943303360256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790946583.240608:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790946583.240618:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9146a032b000/0x16e41aef93271cc8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x16e41aef93271cc1 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946583.240637:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790946583.240662:0:5819:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be849c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+17:3301:x1877943303360256:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946583.240668:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790946583.240682:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790946583.240688:0:5819:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beee4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+16:3303:x1877943303360512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790946583.240697:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790946583.240706:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff914680031e00/0x16e41aef93271ee3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x16e41aef93271edc expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946583.240715:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790946583.240742:0:5819:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beee4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+15:3303:x1877943303360512:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946583.240748:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790946583.240787:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be125880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3303:1877943303360512:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790946583.240822:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be126680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3301:1877943303360256:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790946583.240829:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3301:1877943303360384:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790946583.240844:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790946583.240849:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff914680030800/0x16e41aef9327199c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x16e41aef932719a3 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946583.240856:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914680030800 already unused, calling callback (ffffffffc1d96c20) 10000000:00010000:0.0:1790946583.240860:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff914680030800/0x16e41aef9327199c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x16e41aef932719a3 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946583.240879:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff914680030800/0x16e41aef9327199c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x16e41aef932719a3 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790946583.240885:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff914680030800/0x16e41aef9327199c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x16e41aef932719a3 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790946583.240890:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1790946583.240893:0:5823:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1790946583.240895:0:5823:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1790946583.240913:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff914680030800/0x16e41aef9327199c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x16e41aef932719a3 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946583.240919:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790946583.240932:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff914680030800/0x16e41aef9327199c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x16e41aef932719a3 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946583.240939:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff914680030800/0x16e41aef9327199c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x16e41aef932719a3 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946583.240951:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946583.240953:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946583.240955:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946583.240964:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3303:1877943303360640:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790946583.240988:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:1.0:1790946583.241017:0:13081:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000100:00100000:0.0:1790946583.241019:0:5819:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303360640 00000020:01000000:1.0:1790946583.241024:0:13081:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000100:00100000:0.0:1790946583.241026:0:5819:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303360640 00000020:00000080:1.0:1790946583.241031:0:13081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790946583.241042:0:13081:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000100:00100000:0.0:1790946583.241059:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790946583.241066:0:5819:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be126680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+15:3303:x1877943303360640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790946583.241075:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790946583.241090:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9146c20ca600/0x16e41aef932719a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x16e41aef9327199c expref: 15 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946583.241103:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790946583.241131:0:5819:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be126680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+14:3303:x1877943303360640:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946583.241138:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790946583.241164:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3303:1877943303360640:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790946583.241357:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1790946583.241725:0:13081:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff914586828800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790946583.241732:0:13081:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9146bc862800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790946583.241738:0:13081:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff914684984800 9afc1277-e08f-4ee9-9b29-b05bfc41dd4e 192.168.203.13@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790946583.241743:0:13081:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff914682e599c0) has exports, disconnecting them 00000020:00080000:1.0:1790946583.241748:0:13081:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff914586828800), last request at 1790946579 00000020:00000080:1.0:1790946583.241755:0:13081:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x16e41aef93271bb0 00000100:00080000:1.0:1790946583.241791:0:13081:0:(import.c:65:import_set_state_nolock()) ffff91458682a000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1790946583.241854:0:13081:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff914586828800): rc 0 00000020:00000080:1.0:1790946583.241856:0:13081:0:(genops.c:885:class_export_put()) final put ffff914586828800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1790946583.241947:0:13081:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9146bc862800), last request at 1790946579 00000020:00000080:1.0:1790946583.241952:0:13081:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x16e41aef93271ae5 00000100:00080000:1.0:1790946583.241959:0:13081:0:(import.c:65:import_set_state_nolock()) ffff9146bc867800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1790946583.241978:0:13081:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9146bc862800): rc 0 00000020:00000080:1.0:1790946583.241980:0:13081:0:(genops.c:885:class_export_put()) final put ffff9146bc862800/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:3.0:1790946583.242023:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946583.242087:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790946583.244231:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff914586828800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1790946583.244298:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff91458682a000 for lustre-MDT0000 00000004:00000080:1.0:1790946583.245957:0:13081:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa164c2b03ae0 00000100:00080000:1.0:1790946583.245987:0:13081:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1790946583.245992:0:13081:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:1.0:1790946583.246013:0:13081:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1790946583.246100:0:13081:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1790946583.246126:0:13081:0:(import.c:65:import_set_state_nolock()) ffff914584b9f000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1790946583.246147:0:13081:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1790946583.246149:0:13081:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:1.0:1790946583.246160:0:13081:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1790946583.246235:0:13081:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1790946583.246246:0:13081:0:(import.c:65:import_set_state_nolock()) ffff914587bb8000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1790946583.246501:0:13081:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff914682e599c0) has no exports 00000100:00100000:3.0:1790946583.246503:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91468e93f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1877943303360768:0@lo:9:umount.0 00000100:00100000:3.0:1790946583.246619:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946583.246688:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91468e93e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1877943303360896:0@lo:9:umount.0 00000100:00100000:3.0:1790946583.246721:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1790946583.246767:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9146bc862800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00100000:3.0:1790946583.246779:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303360768 00000100:00100000:3.0:1790946583.246791:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303360768 00000020:00000080:0.0:1790946583.246826:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9146bc867800 for lustre-MDT0000 00000100:00100000:3.0:1790946583.246855:0:6675:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303360896 00000100:00100000:3.0:1790946583.246860:0:6675:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303360896 00000100:00100000:3.0:1790946583.246909:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1790946583.246920:0:6675:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be0f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1877943303360768:12345-0@lo:9:umount.0 00000020:00000080:3.0:1790946583.246974:0:6675:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x16e41aef93271b32 00000100:00100000:1.0:1790946583.246977:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00080000:3.0:1790946583.246989:0:6675:0:(import.c:65:import_set_state_nolock()) ffff9145853b3800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1790946583.246998:0:6673:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be0f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1877943303360896:12345-0@lo:9:umount.0 00000020:00000080:1.0:1790946583.247029:0:6673:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x16e41aef93271c27 00000100:00080000:1.0:1790946583.247040:0:6673:0:(import.c:65:import_set_state_nolock()) ffff9146bed8f000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790946583.247041:0:6675:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1790946583.247312:0:6675:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be0f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3299:x1877943303360768:12345-0@lo:9:umount.0 Request processed in 393us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946583.247322:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00010000:3.0:1790946583.247379:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1790946583.247385:0:6673:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00080000:3.0:1790946583.247426:0:3299:0:(import.c:65:import_set_state_nolock()) ffff914584b9f000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1790946583.247454:0:3299:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1790946583.247457:0:3299:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790946583.247461:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91468e93f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1877943303360768:0@lo:9:umount.0 00000100:00100000:1.0:1790946583.247813:0:6673:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be0f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3299:x1877943303360896:12345-0@lo:9:umount.0 Request processed in 822us (1092us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946583.247824:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:3.0:1790946583.247852:0:3299:0:(import.c:65:import_set_state_nolock()) ffff914587bb8000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1790946583.247907:0:3299:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00080000:0.0:1790946583.247991:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1790946583.248547:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1790946583.251598:0:3299:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790946583.251620:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91468e93e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1877943303360896:0@lo:9:umount.0 00000020:00080000:1.0:1790946583.268121:0:13081:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff914682e599c0) has no exports 00000020:00000080:1.0:1790946583.311365:0:13081:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x16e41aef932719f7 00000020:00000080:1.0:1790946583.311381:0:13081:0:(genops.c:885:class_export_put()) final put ffff91469e2de800/lustre-QMT0000_UUID 00000020:01000000:1.0:1790946583.311443:0:13081:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1790946583.311545:0:13081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790946583.311555:0:13081:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1790946583.311560:0:13081:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff9146849d8000) has no exports 00000020:00000080:2.0:1790946583.311912:0:13081:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x16e41aef932719f0 00000020:00000080:2.0:1790946583.311918:0:13081:0:(genops.c:885:class_export_put()) final put ffff9146b7970000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1790946583.311945:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff91469e2de800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1790946583.312120:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9146b7970000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1790946583.312169:0:13081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790946583.312440:0:13081:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1790946583.312446:0:13081:0:(genops.c:885:class_export_put()) final put ffff9146b581c000/lustre-QMT0000_UUID 00000020:00000080:2.0:1790946583.312448:0:13081:0:(genops.c:844:class_export_destroy()) destroying export ffff9146b581c000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1790946583.312460:0:13081:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:3.0:1790946583.856561:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1790946584.168689:0:6700:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7eed1f4b-bd5b-4a70-8045-59db065b3dfc 00000020:00000080:1.0:1790946584.168700:0:6700:0:(genops.c:885:class_export_put()) final put ffff914684945800/7eed1f4b-bd5b-4a70-8045-59db065b3dfc 00000001:00100000:1.0:1790946584.168784:0:6700:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790946584.168787:0:6700:0:(genops.c:885:class_export_put()) final put ffff9145853b7000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1790946584.168810:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff914684945800/7eed1f4b-bd5b-4a70-8045-59db065b3dfc for lustre-OST0000 00000020:00000080:2.0:1790946584.168873:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff914684946000 for lustre-OST0000 00000020:00000080:3.0:1790946584.170850:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9145853b7000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1790946584.171440:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9145853b3800 for lustre-OST0000 00000100:00100000:2.0:1790946584.562513:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be125880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1877943303361152:0@lo:400:kworker.0 00000100:00100000:0.0:1790946584.562513:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1877943303361280:0@lo:400:kworker.0 00000100:00100000:2.0:1790946584.562648:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946584.562728:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790946584.562735:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3301:1877943303361024:0@lo:400:kworker.0 00000100:00100000:2.0:1790946584.562768:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946584.562799:0:5829:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303361024 00000100:00100000:2.0:1790946584.562801:0:11315:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303361152 00000100:00100000:2.0:1790946584.562809:0:11315:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303361152 00000100:00100000:1.0:1790946584.562809:0:5829:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303361024 00000100:00100000:2.0:1790946584.562851:0:11315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1790946584.562851:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1790946584.562859:0:11315:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3301:x1877943303361152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946584.562861:0:5829:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146835b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+14:3301:x1877943303361024:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1790946584.562868:0:11315:0:(tgt_handler.c:821:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1790946584.563042:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946584.563078:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303361280 00000100:00100000:0.0:1790946584.563082:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303361280 00000100:00100000:0.0:1790946584.563107:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1790946584.563112:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3302:x1877943303361280:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1790946584.563117:0:6803:0:(tgt_handler.c:821:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1790946584.563158:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3302:x1877943303361280:12345-0@lo:400:kworker.0 Request processed in 45us (115us total) trans 0 rc -107/-107 00000100:00100000:0.0:1790946584.563164:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:0.0:1790946584.563226:0:3302:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1790946584.563233:0:3302:0:(import.c:65:import_set_state_nolock()) ffff914586829800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1790946584.563238:0:3302:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1790946584.563363:0:5829:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146835b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5054f39f-0b4d-4846-a244-9f8dda5fa3cd+14:3301:x1877943303361024:12345-0@lo:400:kworker.0 Request processed in 503us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946584.563371:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1790946584.566183:0:11315:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3301:x1877943303361152:12345-0@lo:400:kworker.0 Request processed in 3306us (3519us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790946584.566216:0:11315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1790946584.567538:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3301:1877943303361024:0@lo:400:kworker.0 00000100:00080000:3.0:1790946584.567580:0:3301:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1790946584.567587:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9146bdcea000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1790946584.567592:0:3301:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1790946584.567598:0:3301:0:(import.c:65:import_set_state_nolock()) ffff9146bdcea000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790946584.567603:0:3301:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 159 00000100:00080000:3.0:1790946584.567617:0:3301:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9146bdcea000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:3.0:1790946584.567743:0:3301:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff914698015180 x1877943303361408/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790946584.567787:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be125880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1877943303361152:0@lo:400:kworker.0 00000100:00100000:2.0:1790946584.568182:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914698015180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3299:1877943303361408:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1790946584.568307:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946584.568547:0:5835:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303361408 00000100:00100000:3.0:1790946584.568557:0:5835:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303361408 00000100:00100000:3.0:1790946584.568612:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1790946584.568621:0:5835:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5fdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3299:x1877943303361408:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:3.0:1790946584.568660:0:5835:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:0.0:1790946584.588427:0:3302:0:(import.c:65:import_set_state_nolock()) ffff914586829800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790946584.588446:0:3302:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 177 00000100:00080000:0.0:1790946584.588469:0:3302:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff914586829800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:0.0:1790946584.588560:0:3302:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9146be98df80 x1877943303361536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790946584.588587:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1877943303361280:0@lo:400:kworker.0 00000100:00100000:3.0:1790946584.588798:0:5835:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5fdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3299:x1877943303361408:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 20173us (20487us total) trans 0 rc -19/-19 00000100:00100000:3.0:1790946584.588813:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:2.0:1790946584.589044:0:3299:0:(import.c:65:import_set_state_nolock()) ffff9146bdcea000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790946584.589052:0:3299:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790946584.589056:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914698015180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3299:1877943303361408:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1790946584.589390:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be98df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1877943303361536:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1790946584.589485:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946584.589618:0:6803:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303361536 00000100:00100000:0.0:1790946584.589627:0:6803:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303361536 00000100:00100000:0.0:1790946584.589737:0:6803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1790946584.589746:0:6803:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5a69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3299:x1877943303361536:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:0.0:1790946584.589767:0:6803:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1790946584.589869:0:6803:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5a69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3299:x1877943303361536:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 122us (383us total) trans 0 rc -19/-19 00000100:00100000:0.0:1790946584.589877:0:6803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:2.0:1790946584.589929:0:3299:0:(import.c:65:import_set_state_nolock()) ffff914586829800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790946584.589934:0:3299:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790946584.589938:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be98df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1877943303361536:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:0.0:1790946584.881235:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946585.906040:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1790946586.172158:0:7645:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1790946586.172170:0:7645:0:(genops.c:885:class_export_put()) final put ffff9146bed8a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790946586.173091:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9146bed8a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1790946586.173165:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9146bed8f000 for lustre-OST0001 00000001:00100000:1.0:1790946586.181518:0:5857:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9afc1277-e08f-4ee9-9b29-b05bfc41dd4e 00000001:00080000:1.0:1790946586.181535:0:5857:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:1.0:1790946586.181540:0:5857:0:(genops.c:885:class_export_put()) final put ffff914684984800/9afc1277-e08f-4ee9-9b29-b05bfc41dd4e 00000020:00000080:0.0:1790946586.181593:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff914684984800/9afc1277-e08f-4ee9-9b29-b05bfc41dd4e for lustre-MDT0000 00000020:00000080:0.0:1790946586.181652:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff914684982800 for lustre-MDT0000 00010000:00010000:0.0:1790946586.928440:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946587.954890:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946588.976428:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1790946589.360314:0:13081:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9146900ed780 - data ffff9146c1e37510/ffff9146bece9400 00000020:01000000:2.0:1790946589.360453:0:13081:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9146900f5000 - data ffff9146b8357798/ffff91468348ec00 00000001:00000004:2.0:1790946589.366760:0:13081:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00080000:0.0:1790946589.445430:0:13081:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1790946589.445439:0:13081:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:0.0:1790946589.445458:0:13081:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1790946589.445460:0:13081:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1790946589.448392:0:6801:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1790946589.448400:0:6801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:3.0:1790946589.448416:0:6801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1790946589.449435:0:13081:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1790946589.449441:0:13081:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:0.0:1790946589.449457:0:13081:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1790946589.449459:0:13081:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1790946589.451228:0:7989:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1790946589.451234:0:7989:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:2.0:1790946589.451248:0:7989:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1790946589.538184:0:13081:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x16e41aef932719bf 00000020:00000080:3.0:1790946589.538197:0:13081:0:(genops.c:885:class_export_put()) final put ffff9146b665a000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1790946589.540529:0:13081:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x16e41aef932719d4 00000020:00000080:3.0:1790946589.540544:0:13081:0:(genops.c:885:class_export_put()) final put ffff9146b665c000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790946589.540597:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9146b665a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1790946589.540683:0:13081:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1790946589.540692:0:13081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790946589.540701:0:13081:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1790946589.540706:0:13081:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff914682e58000) has no exports 00000004:01000000:3.0:1790946589.540887:0:13081:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1790946589.540895:0:13081:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x16e41aef93271c12 00000020:00000080:3.0:1790946589.540900:0:13081:0:(genops.c:885:class_export_put()) final put ffff914587bbf000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790946589.540979:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9146b665c000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1790946589.541036:0:13081:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1790946589.541041:0:13081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790946589.541055:0:13081:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1790946589.541058:0:13081:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff914684fb19c0) has no exports 00000020:00000080:3.0:1790946589.541064:0:13081:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x16e41aef93271c0b 00000020:00000080:3.0:1790946589.541068:0:13081:0:(genops.c:885:class_export_put()) final put ffff914587bbe000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1790946589.541131:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff914587bbf000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:3.0:1790946589.541612:0:13081:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1790946589.541617:0:13081:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1790946589.541621:0:13081:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:3.0:1790946589.541637:0:13081:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790946589.541640:0:13081:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790946589.541890:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff914587bbe000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1790946589.541981:0:13081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790946589.541989:0:13081:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790946589.541995:0:13081:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x16e41aef93271b2b 00000020:00000080:3.0:1790946589.542000:0:13081:0:(genops.c:885:class_export_put()) final put ffff914584b82000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790946589.542018:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff914587bb8000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1790946589.542023:0:8:0:(genops.c:885:class_export_put()) final put ffff914684ffa800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790946589.542026:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff914684ffa800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1790946589.542030:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1790946589.542278:0:13081:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1790946589.542282:0:13081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790946589.542287:0:13081:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1790946589.542291:0:13081:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff914684fb0000) has no exports 00000020:00000080:3.0:1790946589.542295:0:13081:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x16e41aef93271b24 00000020:00000080:3.0:1790946589.542299:0:13081:0:(genops.c:885:class_export_put()) final put ffff914584b9e000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1790946589.542321:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff914584b82000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:3.0:1790946589.542729:0:13081:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1790946589.542733:0:13081:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1790946589.542736:0:13081:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:3.0:1790946589.542740:0:13081:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1790946589.542742:0:13081:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790946589.542984:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff914584b9e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1790946589.543072:0:13081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790946589.543079:0:13081:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790946589.543107:0:13081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790946589.543110:0:13081:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790946589.543113:0:13081:0:(genops.c:885:class_export_put()) final put ffff9146bc867000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1790946589.543116:0:13081:0:(genops.c:844:class_export_destroy()) destroying export ffff9146bc867000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1790946589.543121:0:13081:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790946589.543294:0:13081:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x16e41aef932719db 00000020:00000080:3.0:1790946589.543300:0:13081:0:(genops.c:885:class_export_put()) final put ffff9146b665f000/lustre-MDD0000_UUID 00000020:00000080:0.0:1790946589.543485:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff914584b9f000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1790946589.543491:0:8:0:(genops.c:885:class_export_put()) final put ffff9146b7975000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790946589.543493:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9146b7975000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1790946589.543498:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1790946589.543608:0:13081:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1790946589.543613:0:13081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790946589.543618:0:13081:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1790946589.543621:0:13081:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff914682e5cd40) has no exports 00000020:00000080:3.0:1790946589.543644:0:13081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790946589.543647:0:13081:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1790946589.543660:0:13081:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x16e41aef932719e2 00000020:00000080:3.0:1790946589.543664:0:13081:0:(genops.c:885:class_export_put()) final put ffff9146b665b800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1790946589.543687:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9146b665f000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1790946589.543691:0:8:0:(genops.c:885:class_export_put()) final put ffff9146b665f800/lustre-MDD0000_UUID 00000020:00000080:0.0:1790946589.543693:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9146b665f800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1790946589.543697:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:3.0:1790946589.544024:0:13081:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9146aa748800 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1790946589.544028:0:13081:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9146aa748800 3 00000020:01000004:3.0:1790946589.544031:0:13081:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9146aa748800 from lustre-MDT0000 00000020:00000080:3.0:1790946589.544055:0:13081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790946589.544059:0:13081:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1790946589.544062:0:13081:0:(genops.c:885:class_export_put()) final put ffff9146b6658800/lustre-MDT0000_UUID 00000020:00000080:3.0:1790946589.544064:0:13081:0:(genops.c:844:class_export_destroy()) destroying export ffff9146b6658800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1790946589.544069:0:13081:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1790946589.544098:0:13081:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:3.0:1790946589.544101:0:13081:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1790946589.544104:0:13081:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1790946589.544107:0:13081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790946589.544109:0:13081:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1790946589.544115:0:13081:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff914685163000 5054f39f-0b4d-4846-a244-9f8dda5fa3cd 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1790946589.544121:0:13081:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff9146849db380) has exports, disconnecting them 00000020:00080000:3.0:1790946589.544125:0:13081:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff914685163000), last request at 1790946357 00000020:00000080:3.0:1790946589.544137:0:13081:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x16e41aef93271980 00000020:00010000:3.0:1790946589.544142:0:13081:0:(genops.c:1920:obd_stale_export_put()) Put export ffff914685163000: total 1 00000100:00080000:3.0:1790946589.544146:0:13081:0:(import.c:65:import_set_state_nolock()) ffff914685161800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1790946589.544166:0:13081:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff914685163000): rc 0 00000020:00080000:3.0:1790946589.544170:0:13081:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff9146849db380) has no exports 00000100:00100000:3.0:1790946589.544245:0:5828:0:(service.c:3206:ptlrpc_main()) ll_mgs_0001: service thread [ffff914682e34a00:5828] 1 exiting: rc = 0 00000020:00010000:2.0:1790946589.544405:0:5822:0:(genops.c:1906:obd_stale_export_get()) Get export ffff914685163000: total 1 00000100:00100000:1.0:1790946589.544431:0:5829:0:(service.c:3206:ptlrpc_main()) ll_mgs_0002: service thread [ffff91468359cc00:5829] 2 exiting: rc = 0 00010000:00010000:2.0:1790946589.544445:0:5822:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff914685163000, canceled 0 locks, left on hash table 8. 00010000:00010000:2.0:1790946589.544472:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9146a032b800/0x16e41aef93271cd6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x16e41aef93271ccf expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946589.544488:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9146c20cae00/0x16e41aef93271a98 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x16e41aef93271a91 expref: 8 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946589.544516:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9146a032b200/0x16e41aef93271c82 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x16e41aef93271c7b expref: 7 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946589.544526:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff914680031c00/0x16e41aef93271c90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x16e41aef93271c89 expref: 6 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946589.544535:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9146a032b600/0x16e41aef93271cac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x16e41aef93271ca5 expref: 5 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946589.544544:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9146b180e000/0x16e41aef93271c9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x16e41aef93271c97 expref: 4 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946589.544556:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9146b180fe00/0x16e41aef93271ec7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x16e41aef93271ec0 expref: 3 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946589.544564:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9146c20caa00/0x16e41aef93271ed5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x16e41aef93271ece expref: 2 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946589.544574:0:5822:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff914685163000, canceled 8 locks, left on hash table 0. 00000020:00000080:2.0:1790946589.544634:0:5822:0:(genops.c:885:class_export_put()) final put ffff914685163000/5054f39f-0b4d-4846-a244-9f8dda5fa3cd 00000020:00000080:0.0:1790946589.544795:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9146b665b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:2.0:1790946589.544858:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946589.544861:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946589.544863:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946589.544885:0:5827:0:(service.c:3206:ptlrpc_main()) ll_mgs_0000: service thread [ffff914682e35200:5827] 0 exiting: rc = 1 00000100:00100000:3.0:1790946589.544975:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946589.544984:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946589.544990:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946589.544995:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946589.545001:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946589.545006:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946589.545011:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946589.545017:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946589.545030:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946589.545036:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946589.545094:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946589.545103:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946589.545110:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946589.545115:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946589.545122:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946589.545128:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946589.545134:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946589.545143:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946589.545148:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946589.545154:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946589.545160:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946589.545165:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946589.545170:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946589.545175:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946589.545180:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946589.545186:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946589.545190:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946589.545195:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946589.545254:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946589.545262:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946589.545268:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946589.545273:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946589.545277:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946589.545282:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946589.545288:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946589.545293:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946589.545298:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946589.545304:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946589.545310:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946589.545315:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946589.545320:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946589.545326:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946589.545331:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946589.545344:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946589.545350:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946589.545355:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946589.545360:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946589.545366:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946589.545371:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946589.545376:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946589.545390:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946589.545395:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946589.545400:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946589.545405:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946589.545411:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946589.545417:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946589.545485:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946589.545493:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946589.545499:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946589.545504:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946589.545510:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946589.545516:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946589.545521:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946589.545527:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1790946589.545933:0:13081:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1790946589.545937:0:13081:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00000080:0.0:1790946589.546148:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff914685163000/5054f39f-0b4d-4846-a244-9f8dda5fa3cd for MGS 00000020:00000080:0.0:1790946589.546193:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff914685161800 for MGS 00000020:01000000:3.0:1790946589.547115:0:13081:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff91468749ea20 - data ffff9146966506c0/ffff9146beff6400 00000020:01000000:3.0:1790946589.548322:0:13081:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff91468662fa20 - data ffff9146b8359438/ffff914682ed5800 00000020:00000080:3.0:1790946589.548983:0:13081:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x16e41aef93271964 00000020:00000080:3.0:1790946589.548990:0:13081:0:(genops.c:885:class_export_put()) final put ffff914682aeb800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1790946589.549009:0:13081:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9146aa748800 from MGS, refs=2 00000020:01000004:3.0:1790946589.549012:0:13081:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9146aa748800 2 00000020:01000004:3.0:1790946589.549015:0:13081:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9146aa748800 from MGS 00000020:00000080:3.0:1790946589.549036:0:13081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790946589.549042:0:13081:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1790946589.549119:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff914682aeb800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1790946589.549146:0:13081:0:(genops.c:885:class_export_put()) final put ffff9146a3750000/MGS 00000020:00000080:3.0:1790946589.549150:0:13081:0:(genops.c:844:class_export_destroy()) destroying export ffff9146a3750000/MGS for MGS 00000020:01000000:3.0:1790946589.549155:0:13081:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1790946589.549252:0:13081:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1790946589.549256:0:13081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790946589.549262:0:13081:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1790946589.549269:0:13081:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9146bdceb800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1790946589.549275:0:13081:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff914684fb4d40) has exports, disconnecting them 00000020:00080000:3.0:1790946589.549281:0:13081:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9146bdceb800), last request at 1790946358 00000020:00000080:3.0:1790946589.549285:0:13081:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x16e41aef93271a2f 00000020:00080000:3.0:1790946589.549293:0:13081:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9146bdceb800): rc 0 00000020:00000080:3.0:1790946589.549297:0:13081:0:(genops.c:885:class_export_put()) final put ffff9146bdceb800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1790946589.549499:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9146bdceb800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1790946589.552268:0:13081:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1790946589.552276:0:13081:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790946589.552280:0:13081:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1790946589.552286:0:13081:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1790946589.552467:0:13081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790946589.552489:0:13081:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1790946589.552496:0:13081:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9146aa748800 1 00000020:00000080:2.0:1790946589.552501:0:13081:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x16e41aef93271956 00000020:00000080:2.0:1790946589.552508:0:13081:0:(genops.c:885:class_export_put()) final put ffff9146a3755000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1790946589.552514:0:13081:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1790946589.552518:0:13081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790946589.552521:0:13081:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1790946589.552525:0:13081:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff91469e0bcd40) has no exports 00000020:00000080:0.0:1790946589.558299:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff914684fc3000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1790946589.558314:0:36:0:(genops.c:885:class_export_put()) final put ffff914688734000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1790946589.558317:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff914688734000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1790946589.558329:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1790946589.558414:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9146a3755000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1790946589.597390:0:13081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790946589.597404:0:13081:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1790946589.597409:0:13081:0:(genops.c:885:class_export_put()) final put ffff914687480800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1790946589.597413:0:13081:0:(genops.c:844:class_export_destroy()) destroying export ffff914687480800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1790946589.597424:0:13081:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1790946589.597548:0:13081:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9146aa74d800 00000020:01000000:0.0:1790946589.597566:0:13081:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1790946589.597570:0:13081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790946589.597574:0:13081:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1790946589.597578:0:13081:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff91469e0bb380) has no exports 00000100:00100000:0.0:1790946589.597655:0:6803:0:(service.c:3206:ptlrpc_main()) mdt00_003: service thread [ffff91468398b800:6803] 3 exiting: rc = 0 00000100:00100000:0.0:1790946589.598273:0:5834:0:(service.c:3206:ptlrpc_main()) mdt00_000: service thread [ffff9146a058ea00:5834] 0 exiting: rc = 1 00000100:00100000:3.0:1790946589.599907:0:5835:0:(service.c:3206:ptlrpc_main()) mdt00_001: service thread [ffff914687ae4e00:5835] 1 exiting: rc = 0 00000100:00100000:0.0:1790946589.600279:0:5836:0:(service.c:3206:ptlrpc_main()) mdt00_002: service thread [ffff914682f3e200:5836] 2 exiting: rc = 0 00000100:00100000:0.0:1790946589.600337:0:11315:0:(service.c:3206:ptlrpc_main()) mdt00_004: service thread [ffff9146980c7400:11315] 4 exiting: rc = 0 00000100:00100000:0.0:1790946589.600430:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.600438:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.600444:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.600449:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.600454:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.600459:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.600465:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.600470:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.600475:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.600480:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.600485:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.600490:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.600495:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.600500:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.600506:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.600511:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.600516:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.600522:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.600539:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.600545:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.600550:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.600555:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.600561:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.600565:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.600570:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.600575:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.600580:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.600585:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.600591:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.600596:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.600601:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.600614:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.600620:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.600625:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.600631:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.600637:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.600641:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.600646:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.600651:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.600656:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.600662:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.600666:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.600672:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.600676:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.600682:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.600686:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.600691:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.600696:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.600701:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.600709:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.600714:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.600719:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.600724:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.600734:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.600739:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.600743:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.600748:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.600753:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.600758:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.600762:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.600767:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.600772:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.600776:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.600782:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946589.617184:0:5837:0:(service.c:3206:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff914682f3e800:5837] 0 exiting: rc = 1 00000100:00100000:2.0:1790946589.617302:0:5838:0:(service.c:3206:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff914682e67e00:5838] 1 exiting: rc = 0 00000100:00100000:0.0:1790946589.618767:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.618787:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.618797:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.618804:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.618810:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.618815:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.618821:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.618827:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.618833:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.618839:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.618845:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.618850:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.618856:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.618861:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.618866:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.618871:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.618877:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.618883:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.618888:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.618893:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.618899:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.618904:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.618909:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.618915:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.618932:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.618937:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.618942:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.618948:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.618953:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.618958:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.618962:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.618967:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.618972:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.618977:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.618982:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.618987:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.618992:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.618996:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.619001:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.619006:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.619011:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.619016:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.619021:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.619026:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.619031:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.619037:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.619043:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.619048:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.619054:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.619059:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.619064:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.619069:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.619946:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.619953:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.619958:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.619963:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.619968:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.619973:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.619979:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.619994:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.619999:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.620004:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.620009:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.620014:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946589.622321:0:5839:0:(service.c:3206:ptlrpc_main()) mdt_out00_000: service thread [ffff9146a058f000:5839] 0 exiting: rc = 1 00000100:00100000:0.0:1790946589.622326:0:5840:0:(service.c:3206:ptlrpc_main()) mdt_out00_001: service thread [ffff9146a058ec00:5840] 1 exiting: rc = 0 00000100:00100000:0.0:1790946589.627317:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.627327:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.627349:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.627356:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.627362:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.627368:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.627374:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.627414:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.627422:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.627427:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.627434:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.627441:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.627447:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.627453:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.627460:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.627477:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.627485:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.627491:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.627497:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.627521:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.627529:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.627536:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.627541:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.627549:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.627555:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.627562:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.627569:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.627575:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.627581:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.627600:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.627607:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.627628:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.627636:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.627641:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.627648:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.628039:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.628046:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.628052:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.628058:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.628063:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.628069:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.628261:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.628269:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.628300:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.628308:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.628315:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.628321:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.628327:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.628334:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.628340:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.628346:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.628353:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.628358:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.628364:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.628370:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.628402:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.628410:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.628415:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.628427:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.628433:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.628438:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.628444:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.628450:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.628457:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946589.637682:0:5841:0:(service.c:3206:ptlrpc_main()) mdt_seqs_0000: service thread [ffff914682f3fc00:5841] 0 exiting: rc = 1 00000100:00100000:2.0:1790946589.637767:0:5842:0:(service.c:3206:ptlrpc_main()) mdt_seqs_0001: service thread [ffff914682f3ea00:5842] 1 exiting: rc = 0 00000100:00100000:0.0:1790946589.637941:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.637948:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.637953:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.637958:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.637963:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.637968:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.637973:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.637978:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.637983:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.637988:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.637992:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.637997:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.638002:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.638007:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.638012:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.638018:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.638023:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.638027:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.638032:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.638036:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.638040:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.638045:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.638050:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.638055:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.638060:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.638064:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.638069:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.638073:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.638078:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.638167:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.638174:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.638178:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.638183:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.638187:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.638191:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.638237:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.638242:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.638247:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.638252:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.638256:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.638260:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.638265:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.638272:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.638277:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.638282:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.638351:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.638358:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.638362:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.638371:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.638376:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.638390:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.638395:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.638400:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.638405:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.638410:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.638415:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.638419:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.638423:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.638428:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.638434:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.638438:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.638442:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.638447:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.638455:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946589.640785:0:5844:0:(service.c:3206:ptlrpc_main()) mdt_seqm_0001: service thread [ffff914682f3fe00:5844] 1 exiting: rc = 0 00000100:00100000:2.0:1790946589.640882:0:5843:0:(service.c:3206:ptlrpc_main()) mdt_seqm_0000: service thread [ffff914682f3e000:5843] 0 exiting: rc = 1 00000100:00100000:0.0:1790946589.640959:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.640966:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.640972:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.640977:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.640982:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.640987:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.641006:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.641012:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.641018:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.641024:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.641029:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.641034:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.641038:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.641043:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.641048:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.641054:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.641058:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.641063:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.641067:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.641082:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.641088:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.641398:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.641404:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.641409:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.641414:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.641418:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.641423:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.641428:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.641432:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.641437:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.641442:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.641446:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.641450:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.641454:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.641458:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.641463:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.641467:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.641470:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.641474:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.642225:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.642238:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.642256:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.642261:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.642266:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.642272:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.642278:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.642355:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.642362:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.642368:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.642373:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.642378:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.642401:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.642405:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.642411:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.642417:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.642421:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.642426:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.642465:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.642472:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.642478:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.642483:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.642488:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.642492:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.642497:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946589.645634:0:5846:0:(service.c:3206:ptlrpc_main()) mdt_fld_0001: service thread [ffff914682f14800:5846] 1 exiting: rc = 0 00000100:00100000:2.0:1790946589.645967:0:5845:0:(service.c:3206:ptlrpc_main()) mdt_fld_0000: service thread [ffff914682f15a00:5845] 0 exiting: rc = 1 00000100:00100000:0.0:1790946589.646035:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.646044:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.646049:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.646055:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.646059:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.646065:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.646079:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.646093:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.646101:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.646107:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.646113:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.646120:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.646146:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.646152:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.646157:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.646162:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.646167:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.646173:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.646178:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.646183:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.646188:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.646192:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.646197:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.646218:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.646223:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.646228:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.646233:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.646238:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.646242:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.646247:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.646251:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.646256:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.646262:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.646268:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.646274:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.646282:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.646290:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.646297:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.646302:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.646307:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.646314:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.646319:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.646324:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.646328:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.646333:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.646340:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.646344:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.646355:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.646360:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.646365:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.646370:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.646375:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.646389:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.646394:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.646399:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.646404:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.646409:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.646414:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.646419:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.646423:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.646428:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.646433:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.646438:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.646442:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.648331:0:5848:0:(service.c:3206:ptlrpc_main()) mdt_io00_001: service thread [ffff914682f15200:5848] 1 exiting: rc = 0 00000100:00100000:2.0:1790946589.649889:0:5847:0:(service.c:3206:ptlrpc_main()) mdt_io00_000: service thread [ffff914682f14c00:5847] 0 exiting: rc = 1 00000100:00100000:1.0:1790946589.650884:0:5849:0:(service.c:3206:ptlrpc_main()) mdt_io00_002: service thread [ffff914682f1cc00:5849] 2 exiting: rc = 0 00000100:00100000:0.0:1790946589.656850:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.656859:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.656864:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.656869:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.656875:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.656880:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.656886:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.656891:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.656896:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.656901:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.656906:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.656912:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.656917:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.656922:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.656926:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.656932:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.656953:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.656974:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.656980:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.656985:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.656990:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.656995:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.657002:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.657008:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.657014:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.657020:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.657026:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.657032:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.657038:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.657043:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.657049:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.657055:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.657061:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.657066:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.657082:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.657088:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.657094:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.657100:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.657105:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.657111:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.657144:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.657151:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.657157:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.657164:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.657170:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.657175:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.657180:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.657187:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.657192:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.657213:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.657220:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.657225:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.657238:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.657244:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.657250:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.657256:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.657261:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.657267:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.657272:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.657277:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.657283:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.657288:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.657293:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946589.657299:0:13081:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1790946589.661329:0:13081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790946589.661340:0:13081:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1790946589.661346:0:13081:0:(genops.c:885:class_export_put()) final put ffff914684ffb000/MDS_uuid 00000020:00000080:0.0:1790946589.661350:0:13081:0:(genops.c:844:class_export_destroy()) destroying export ffff914684ffb000/MDS_uuid for MDS 00000020:01000000:0.0:1790946589.661355:0:13081:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1790946589.661489:0:13081:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00000100:00080000:0.0:1790946589.681615:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790946589.681622:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1790946589.681626:0:36:0:(import.c:65:import_set_state_nolock()) ffff9146bdcea000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790946589.681633:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 369 00000100:00080000:0.0:1790946589.681639:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1790946589.681649:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9146bdcea000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:0.0:1790946589.681670:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9146be98f800 x1877943303361792/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790946589.681686:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790946589.681689:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1790946589.681691:0:36:0:(import.c:65:import_set_state_nolock()) ffff914586829800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790946589.681694:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 369 00000100:00080000:0.0:1790946589.681705:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1790946589.681710:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff914586829800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:0.0:1790946589.681721:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9146be98e680 x1877943303361920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790946589.681759:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790946589.681773:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be98ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3302:1877943303361664:0@lo:400:kworker.0 00000400:00000100:0.0:1790946589.681820:0:3302:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877943303361664 offset 0 length 224: 4 00000100:00100000:0.0:1790946589.681871:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be98f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3299:1877943303361792:0@lo:38:kworker.0 00000400:00000100:0.0:1790946589.681889:0:3299:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877943303361792 offset 0 length 520: 4 00000100:00100000:0.0:1790946589.681901:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be98e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1877943303361920:0@lo:38:kworker.0 00000400:00000100:0.0:1790946589.681916:0:3299:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877943303361920 offset 0 length 520: 4 00010000:00010000:1.0:1790946590.000780:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946591.027902:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946592.048349:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1790946592.490479:0:13239:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1790946592.519405:0:13239:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1790946592.519455:0:13239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146a032a600/0x16e41aef93271c97 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271c9e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946592.519469:0:13239:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146a032a600/0x16e41aef93271c97 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93271c9e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946592.519477:0:13239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146a032a600/0x16e41aef93271c97 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x16e41aef93271c9e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946592.519484:0:13239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff9146a032a600/0x16e41aef93271c97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x16e41aef93271c9e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946592.519516:0:13239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1790946592.519521:0:13239:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1790946592.519621:0:13239:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790946592.519632:0:13239:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9146be98f800 x1877943303361792/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790946604 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946592.519657:0:13239:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1790946592.519663:0:13239:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1790946592.519670:0:13239:0:(import.c:65:import_set_state_nolock()) ffff9146bdcea000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1790946592.519674:0:13239:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790946592.519678:0:13239:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9146be98f800 x1877943303361792/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790946604 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946592.519685:0:13239:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1790946592.519688:0:13239:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00010000:00010000:2.0:1790946592.519782:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946592.519789:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9146a032a600/0x16e41aef93271c97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x16e41aef93271c9e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946592.519797:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146a032a600 already unused, calling callback (ffffffffc1d96c20) 10000000:00010000:2.0:1790946592.519801:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9146a032a600/0x16e41aef93271c97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x16e41aef93271c9e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946592.519810:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9146a032a600/0x16e41aef93271c97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x16e41aef93271c9e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790946592.519818:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9146a032a600/0x16e41aef93271c97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x16e41aef93271c9e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790946592.519830:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790946592.519833:0:5822:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1790946592.519835:0:5822:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1790946592.519870:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9146a032a600/0x16e41aef93271c97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x16e41aef93271c9e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946592.519877:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790946592.519903:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9146a032a600/0x16e41aef93271c97 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x16e41aef93271c9e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946592.519911:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9146a032a600/0x16e41aef93271c97 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x16e41aef93271c9e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946592.519921:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946592.519923:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946592.519924:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946592.520073:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be98f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3299:1877943303361792:0@lo:38:kworker.0 00000100:00100000:0.0:1790946592.520320:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790946592.520335:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5a69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3301:1877943303362048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790946592.520413:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946592.521112:0:5819:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303362048 00000100:00100000:1.0:1790946592.521121:0:5819:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303362048 00000100:00100000:1.0:1790946592.521162:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790946592.521178:0:5819:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be98ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3301:x1877943303362048:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1790946592.521185:0:5819:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790946592 with bad export cookie 1649472979792763264 00010000:00010000:2.0:1790946592.523937:0:13239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146a032aa00/0x16e41aef93271ca5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271cac expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946592.523955:0:13239:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146a032aa00/0x16e41aef93271ca5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93271cac expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946592.523963:0:13239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146a032aa00/0x16e41aef93271ca5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x16e41aef93271cac expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946592.523970:0:13239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff9146a032aa00/0x16e41aef93271ca5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x16e41aef93271cac expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946592.523993:0:13239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790946592.524014:0:13239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146c20ca200/0x16e41aef93271ece lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271ed5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946592.524021:0:13239:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146c20ca200/0x16e41aef93271ece lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93271ed5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946592.524654:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790946592.524662:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9146a032aa00/0x16e41aef93271ca5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x16e41aef93271cac expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946592.524670:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146a032aa00 already unused, calling callback (ffffffffc1d96c20) 10000000:00010000:0.0:1790946592.524674:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9146a032aa00/0x16e41aef93271ca5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x16e41aef93271cac expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946592.524684:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9146a032aa00/0x16e41aef93271ca5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x16e41aef93271cac expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790946592.524691:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9146a032aa00/0x16e41aef93271ca5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x16e41aef93271cac expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790946592.524697:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790946592.524708:0:5823:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:0.0:1790946592.524745:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9146a032aa00/0x16e41aef93271ca5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x16e41aef93271cac expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946592.524752:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790946592.524775:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9146a032aa00/0x16e41aef93271ca5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x16e41aef93271cac expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946592.524783:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9146a032aa00/0x16e41aef93271ca5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x16e41aef93271cac expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946592.524798:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946592.524800:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946592.524801:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946592.524810:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790946592.524826:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be98d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3300:1877943303362176:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790946592.524895:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946592.524945:0:5820:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1790946592.524952:0:5820:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1790946592.525113:0:13239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146c20ca200/0x16e41aef93271ece lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x16e41aef93271ed5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946592.525120:0:13239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff9146c20ca200/0x16e41aef93271ece lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x16e41aef93271ed5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946592.525136:0:13239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1790946592.525141:0:13239:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:2.0:1790946592.525146:0:13239:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1790946592.525175:0:13239:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1790946592.525179:0:13239:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00010000:00010000:2.0:1790946592.525190:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946592.525194:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9146c20ca200/0x16e41aef93271ece lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x16e41aef93271ed5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946592.525214:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146c20ca200 already unused, calling callback (ffffffffc1d96c20) 10000000:00010000:2.0:1790946592.525217:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9146c20ca200/0x16e41aef93271ece lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x16e41aef93271ed5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946592.525224:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9146c20ca200/0x16e41aef93271ece lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x16e41aef93271ed5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790946592.525229:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9146c20ca200/0x16e41aef93271ece lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x16e41aef93271ed5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790946592.525246:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1790946592.525248:0:5822:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1790946592.525250:0:5822:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1790946592.525266:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9146c20ca200/0x16e41aef93271ece lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x16e41aef93271ed5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946592.525272:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790946592.525289:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9146c20ca200/0x16e41aef93271ece lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x16e41aef93271ed5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946592.525295:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9146c20ca200/0x16e41aef93271ece lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x16e41aef93271ed5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946592.525305:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946592.525307:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946592.525309:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790946592.525317:0:13239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790946592.525324:0:13239:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1790946592.525328:0:13239:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff9146849d99c0) has no exports 00000020:00080000:2.0:1790946592.525351:0:13239:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff9146849d99c0) has no exports 00000100:00100000:0.0:1790946592.526895:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5a68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3302:1877943303362304:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790946592.526955:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946592.527011:0:5821:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1790946592.527031:0:5821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303362176 00000100:00100000:0.0:1790946592.527039:0:5821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303362176 00000100:00100000:0.0:1790946592.527064:0:5821:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1790946592.527069:0:5821:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303362304 00000100:00100000:0.0:1790946592.527071:0:5821:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303362304 00000100:00100000:3.0:1790946592.527875:0:13240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790946592.527883:0:13240:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914685713850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3300:x1877943303362176:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1790946592.527890:0:13240:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790946592 with bad export cookie 1649472979792763264 00000100:00100000:3.0:1790946592.527956:0:13240:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914685713850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3300:x1877943303362176:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (3060us total) trans 0 rc -107/-107 00000100:00100000:3.0:1790946592.527963:0:13240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790946592.527981:0:13240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790946592.527985:0:13240:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be98ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3302:x1877943303362304:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1790946592.527989:0:13240:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790946592 with bad export cookie 1649472979792763264 00000100:00100000:3.0:1790946592.528020:0:13240:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be98ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3302:x1877943303362304:12345-0@lo:103:ldlm_bl.0 Request processed in 33us (1065us total) trans 0 rc -107/-107 00000100:00100000:3.0:1790946592.528036:0:13240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1790946592.528471:0:3302:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.113@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1790946592.528477:0:3302:0:(import.c:65:import_set_state_nolock()) ffff914685164800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1790946592.528481:0:3302:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.113@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000020:01000000:2.0:1790946592.532725:0:13239:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9146900ed7e0 - data ffff9146b832a948/ffff9146bece9000 00000020:01000000:2.0:1790946592.532887:0:13239:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff91468749e180 - data ffff9146b8173a20/ffff9145853d4c00 00000100:00080000:2.0:1790946592.536946:0:3300:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.113@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:1.0:1790946592.537106:0:5819:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be98ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3301:x1877943303362048:12345-0@lo:103:ldlm_bl.0 Request processed in 15925us (16691us total) trans 0 rc -107/-107 00000100:00100000:1.0:1790946592.537118:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1790946592.537183:0:3301:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.113@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1790946592.552808:0:3302:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.113@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1790946592.552813:0:3302:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1790946592.552822:0:3302:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9146be98ca80 x1877943303361664/t0(0) o400->MGC192.168.203.113@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790946605 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946592.552838:0:3302:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9146b5a69f80 x1877943303362048/t0(0) o103->MGC192.168.203.113@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790946608 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946592.552846:0:3302:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9146be98d180 x1877943303362176/t0(0) o103->MGC192.168.203.113@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790946608 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946592.552855:0:3302:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9146b5a68a80 x1877943303362304/t0(0) o103->MGC192.168.203.113@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790946608 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1790946592.552977:0:3302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1790946592.552981:0:3302:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1790946592.552982:0:3302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1790946592.553084:0:3300:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff914685164800 already not connected (conn 1, was 1): DISCONN 00000100:00080000:1.0:1790946592.553096:0:3301:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff914685164800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:1.0:1790946592.553112:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5a69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3301:1877943303362048:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790946592.553316:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be98d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3300:1877943303362176:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1790946592.553815:0:3302:0:(import.c:65:import_set_state_nolock()) ffff914685164800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790946592.553822:0:3302:0:(import.c:545:import_select_connection()) MGC192.168.203.113@tcp: connect to NID 0@lo last attempt 142 00000100:00080000:0.0:1790946592.553835:0:3302:0:(import.c:666:import_select_connection()) MGC192.168.203.113@tcp: import ffff914685164800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:0.0:1790946592.553863:0:3302:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9146be98e300 x1877943303362432/t0(0) o250->MGC192.168.203.113@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790946592.553892:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be98ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3302:1877943303361664:0@lo:400:kworker.0 00000100:00100000:0.0:1790946592.553908:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5a68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3302:1877943303362304:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790946592.553963:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be98e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3299:1877943303362432:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:1.0:1790946592.554007:0:3299:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877943303362432 offset 0 length 520: 4 00100000:10000000:0.0:1790946592.563889:0:13239:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1790946592.587875:0:13239:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x16e41aef93271ab4 00000020:00000080:1.0:1790946592.587885:0:13239:0:(genops.c:885:class_export_put()) final put ffff914585015800/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1790946592.587959:0:13239:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9146be38b800 from lustre-OST0000, refs=2 00000020:01000004:1.0:1790946592.587964:0:13239:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9146be38b800 2 00000020:01000004:1.0:1790946592.587967:0:13239:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9146be38b800 from lustre-OST0000 00000020:00000080:1.0:1790946592.587990:0:13239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790946592.588001:0:13239:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1790946592.588004:0:13239:0:(genops.c:885:class_export_put()) final put ffff914585017000/lustre-OST0000_UUID 00000020:00000080:1.0:1790946592.588007:0:13239:0:(genops.c:844:class_export_destroy()) destroying export ffff914585017000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1790946592.588013:0:13239:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1790946592.588054:0:13239:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1790946592.588059:0:13239:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1790946592.588062:0:13239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790946592.588068:0:13239:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1790946592.588075:0:13239:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff914584b80800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790946592.588080:0:13239:0:(genops.c:1552:class_disconnect_exports()) OBD device 12 (ffff9146c1ca19c0) has exports, disconnecting them 00000020:00080000:1.0:1790946592.588085:0:13239:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff914584b80800), last request at 1790946374 00000020:00000080:1.0:1790946592.588100:0:13239:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x16e41aef93271ade 00000020:00080000:1.0:1790946592.588109:0:13239:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff914584b80800): rc 0 00000020:00000080:1.0:1790946592.588114:0:13239:0:(genops.c:885:class_export_put()) final put ffff914584b80800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1790946592.588224:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff914585015800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1790946592.588617:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff914584b80800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1790946592.600932:0:13239:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1790946592.600941:0:13239:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790946592.600946:0:13239:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1790946592.600954:0:13239:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790946592.601255:0:13239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790946592.601264:0:13239:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:1.0:1790946592.601271:0:13239:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9146be38b800 1 00000020:00000080:1.0:1790946592.601278:0:13239:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x16e41aef93271a6e 00000020:00000080:1.0:1790946592.601286:0:13239:0:(genops.c:885:class_export_put()) final put ffff9146a03bc800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1790946592.601328:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9146bdcea000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1790946592.601346:0:36:0:(genops.c:885:class_export_put()) final put ffff914584b80000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1790946592.601366:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff914584b80000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1790946592.601374:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:1.0:1790946592.601809:0:13239:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1790946592.601815:0:13239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790946592.601821:0:13239:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1790946592.601825:0:13239:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff91469e0b8000) has no exports 00000020:00000080:2.0:1790946592.601932:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9146a03bc800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1790946592.622980:0:13239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790946592.622996:0:13239:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1790946592.623001:0:13239:0:(genops.c:885:class_export_put()) final put ffff9146be38b000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1790946592.623006:0:13239:0:(genops.c:844:class_export_destroy()) destroying export ffff9146be38b000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1790946592.623017:0:13239:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1790946592.623156:0:13239:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9146be38e800 00000020:02000400:1.0:1790946592.627813:0:13239:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1790946593.072465:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946594.096677:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790946594.800253:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5054f39f-0b4d-4846-a244-9f8dda5fa3cd->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790946594.800263:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 5054f39f-0b4d-4846-a244-9f8dda5fa3cd->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790946594.800267:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790946594.800270:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1790946595.126415:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1790946595.442814:0:13389:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1790946595.460388:0:13389:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1790946595.460504:0:13389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff914688aee800/0x16e41aef93271c7b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271c82 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946595.460523:0:13389:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff914688aee800/0x16e41aef93271c7b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93271c82 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946595.460531:0:13389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff914688aee800/0x16e41aef93271c7b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x16e41aef93271c82 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946595.460558:0:13389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff914688aee800/0x16e41aef93271c7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x16e41aef93271c82 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946595.460577:0:13389:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1790946595.460584:0:13389:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1790946595.460627:0:13389:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790946595.460642:0:13389:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9146be98e680 x1877943303361920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790946604 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946595.460657:0:13389:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1790946595.460664:0:13389:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1790946595.460671:0:13389:0:(import.c:65:import_set_state_nolock()) ffff914586829800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1790946595.460677:0:13389:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790946595.460680:0:13389:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9146be98e680 x1877943303361920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790946604 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790946595.460687:0:13389:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1790946595.460690:0:13389:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 12s for inflight to error out 00010000:00010000:3.0:1790946595.460818:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790946595.460828:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff914688aee800/0x16e41aef93271c7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x16e41aef93271c82 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946595.460837:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aee800 already unused, calling callback (ffffffffc1d96c20) 10000000:00010000:3.0:1790946595.460850:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff914688aee800/0x16e41aef93271c7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x16e41aef93271c82 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946595.460860:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff914688aee800/0x16e41aef93271c7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x16e41aef93271c82 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790946595.460869:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff914688aee800/0x16e41aef93271c7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x16e41aef93271c82 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790946595.460875:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1790946595.460878:0:5822:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1790946595.460880:0:5822:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1790946595.460899:0:5822:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff914685164800 00010000:00010000:3.0:1790946595.460903:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff914688aee800/0x16e41aef93271c7b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x16e41aef93271c82 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946595.460910:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff914688aee800/0x16e41aef93271c7b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x16e41aef93271c82 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946595.460923:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946595.460925:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946595.460927:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946595.461792:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be98e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1877943303361920:0@lo:38:kworker.0 00010000:00010000:3.0:1790946595.463585:0:13389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146a032ac00/0x16e41aef93271c89 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271c90 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946595.463610:0:13389:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146a032ac00/0x16e41aef93271c89 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93271c90 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946595.463618:0:13389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146a032ac00/0x16e41aef93271c89 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x16e41aef93271c90 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946595.463645:0:13389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff9146a032ac00/0x16e41aef93271c89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x16e41aef93271c90 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946595.463672:0:13389:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790946595.463680:0:13389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff914688aeea00/0x16e41aef93271ec0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93271ec7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946595.463687:0:13389:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff914688aeea00/0x16e41aef93271ec0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93271ec7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946595.463694:0:13389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff914688aeea00/0x16e41aef93271ec0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x16e41aef93271ec7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946595.463701:0:13389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff914688aeea00/0x16e41aef93271ec0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x16e41aef93271ec7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946595.463716:0:13389:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1790946595.463722:0:13389:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1790946595.463751:0:13389:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1790946595.463757:0:13389:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00010000:00010000:3.0:1790946595.463770:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790946595.463777:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9146a032ac00/0x16e41aef93271c89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x16e41aef93271c90 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946595.463783:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146a032ac00 already unused, calling callback (ffffffffc1d96c20) 10000000:00010000:3.0:1790946595.463787:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9146a032ac00/0x16e41aef93271c89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x16e41aef93271c90 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946595.463796:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9146a032ac00/0x16e41aef93271c89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x16e41aef93271c90 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790946595.463809:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9146a032ac00/0x16e41aef93271c89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x16e41aef93271c90 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790946595.463815:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1790946595.463819:0:5822:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1790946595.463821:0:5822:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1790946595.463836:0:5822:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff914685164800 00010000:00010000:3.0:1790946595.463840:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9146a032ac00/0x16e41aef93271c89 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x16e41aef93271c90 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946595.463847:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9146a032ac00/0x16e41aef93271c89 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x16e41aef93271c90 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946595.463863:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790946595.463867:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff914688aeea00/0x16e41aef93271ec0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x16e41aef93271ec7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946595.463873:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946595.463875:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aeea00 already unused, calling callback (ffffffffc1d96c20) 10000000:00010000:3.0:1790946595.463881:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff914688aeea00/0x16e41aef93271ec0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x16e41aef93271ec7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946595.463890:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff914688aeea00/0x16e41aef93271ec0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x16e41aef93271ec7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790946595.463897:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff914688aeea00/0x16e41aef93271ec0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x16e41aef93271ec7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790946595.463902:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1790946595.463905:0:5822:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1790946595.463912:0:5822:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1790946595.463919:0:5822:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff914685164800 00010000:00010000:3.0:1790946595.463922:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff914688aeea00/0x16e41aef93271ec0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x16e41aef93271ec7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946595.463929:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff914688aeea00/0x16e41aef93271ec0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x16e41aef93271ec7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946595.463945:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946595.463947:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946595.463949:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1790946595.463960:0:13389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790946595.463968:0:13389:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1790946595.463974:0:13389:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff9146c1ca4d40) has no exports 00000020:00080000:3.0:1790946595.464008:0:13389:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff9146c1ca4d40) has no exports 00000020:01000000:3.0:1790946595.470488:0:13389:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9146a0a5a2a0 - data ffff9146967fcca8/ffff9146beda1400 00000020:01000000:3.0:1790946595.470705:0:13389:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff9146900ed5a0 - data ffff9146b838a288/ffff9145870b3c00 00100000:10000000:1.0:1790946595.489828:0:13389:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1790946595.526961:0:13389:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x16e41aef93271b7f 00000020:00000080:2.0:1790946595.526973:0:13389:0:(genops.c:885:class_export_put()) final put ffff9146bed8c800/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1790946595.527093:0:13389:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9145853b6000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1790946595.527097:0:13389:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9145853b6000 2 00000020:01000004:2.0:1790946595.527102:0:13389:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9145853b6000 from lustre-OST0001 00000020:00000080:2.0:1790946595.527145:0:13389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790946595.527167:0:13389:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1790946595.527171:0:13389:0:(genops.c:885:class_export_put()) final put ffff9146bed8c000/lustre-OST0001_UUID 00000020:00000080:2.0:1790946595.527175:0:13389:0:(genops.c:844:class_export_destroy()) destroying export ffff9146bed8c000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1790946595.527183:0:13389:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1790946595.527370:0:13389:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 5054f39f-0b4d-4846-a244-9f8dda5fa3cd->MGS 00010000:00010000:2.0:1790946595.527391:0:13389:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9146b1932a00/0x16e41aef93271a91 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x16e41aef93271a98 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790946595.527404:0:13389:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9146b1932a00/0x16e41aef93271a91 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x16e41aef93271a98 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790946595.527411:0:13389:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1790946595.527414:0:13389:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1790946595.527417:0:13389:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1790946595.527436:0:13389:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff914685164800 00010000:00010000:2.0:1790946595.527441:0:13389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9146b1932a00/0x16e41aef93271a91 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x16e41aef93271a98 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946595.527458:0:13389:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff914680030e00/0x16e41aef93271ccf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x16e41aef93271cd6 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790946595.527477:0:13389:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff914680030e00/0x16e41aef93271ccf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x16e41aef93271cd6 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790946595.527482:0:13389:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790946595.527484:0:13389:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1790946595.527486:0:13389:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1790946595.527499:0:13389:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff914685164800 00010000:00010000:2.0:1790946595.527501:0:13389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff914680030e00/0x16e41aef93271ccf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x16e41aef93271cd6 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1790946595.527522:0:13389:0:(import.c:65:import_set_state_nolock()) ffff914685164800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1790946595.527527:0:13389:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1790946595.527529:0:13389:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1790946595.527531:0:13389:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1790946595.527536:0:13389:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1790946595.527551:0:13389:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9146be98e300 x1877943303362432/t0(0) o250->MGC192.168.203.113@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1790946602 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1790946595.527568:0:13389:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1790946595.527570:0:13389:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:0.0:1790946595.527682:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be98e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5054f39f-0b4d-4846-a244-9f8dda5fa3cd:3299:1877943303362432:0@lo:250:ptlrpcd_00_02.0 10000000:01000000:2.0:1790946595.527930:0:13389:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1790946595.527939:0:13389:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x16e41aef93271972 00000020:00000080:2.0:1790946595.527946:0:13389:0:(genops.c:885:class_export_put()) final put ffff914684fff800/5054f39f-0b4d-4846-a244-9f8dda5fa3cd 00000020:00000080:3.0:1790946595.528074:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9146bed8c800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1790946595.528146:0:13389:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.113@tcp (flags='') 00000020:00000080:2.0:1790946595.528162:0:13389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790946595.528170:0:13389:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.113@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1790946595.528175:0:13389:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff914682e5b380) has no exports 10000000:01000000:0.0:1790946595.528333:0:5831:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1790946595.528451:0:13389:0:(obd_class.h:668:obd_cleanup_client_import()) MGC192.168.203.113@tcp: client import never connected 00000100:00080000:2.0:1790946595.528455:0:13389:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1790946595.528459:0:13389:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1790946595.528461:0:13389:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1790946595.528473:0:13389:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1790946595.528526:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff914684fff800/5054f39f-0b4d-4846-a244-9f8dda5fa3cd for MGC192.168.203.113@tcp 00000020:00000080:2.0:1790946595.528710:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff914685164800 for MGC192.168.203.113@tcp 00000020:00000080:2.0:1790946595.528747:0:13389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790946595.528754:0:13389:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.113@tcp (uuid 5054f39f-0b4d-4846-a244-9f8dda5fa3cd) 00000020:00000080:2.0:1790946595.528758:0:13389:0:(genops.c:885:class_export_put()) final put ffff914685160800/5054f39f-0b4d-4846-a244-9f8dda5fa3cd 00000020:00000080:2.0:1790946595.528760:0:13389:0:(genops.c:844:class_export_destroy()) destroying export ffff914685160800/5054f39f-0b4d-4846-a244-9f8dda5fa3cd for MGC192.168.203.113@tcp 00000020:01000000:2.0:1790946595.528765:0:13389:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.113@tcp (5054f39f-0b4d-4846-a244-9f8dda5fa3cd) 00000020:01000000:2.0:1790946595.532140:0:13389:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1790946595.532156:0:13389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790946595.532169:0:13389:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1790946595.532179:0:13389:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff914586828000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790946595.532188:0:13389:0:(genops.c:1552:class_disconnect_exports()) OBD device 16 (ffff9146849dcd40) has exports, disconnecting them 00000020:00080000:2.0:1790946595.532194:0:13389:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff914586828000), last request at 1790946392 00000020:00000080:2.0:1790946595.532900:0:13389:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x16e41aef93271ba9 00000020:00080000:2.0:1790946595.532924:0:13389:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff914586828000): rc 0 00000020:00000080:2.0:1790946595.532930:0:13389:0:(genops.c:885:class_export_put()) final put ffff914586828000/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1790946595.534956:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff914586828000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1790946595.536959:0:13389:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1790946595.536970:0:13389:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790946595.536976:0:13389:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1790946595.536987:0:13389:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790946595.537304:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff914586829800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:3.0:1790946595.537379:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1790946595.537597:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:0.0:1790946595.537813:0:5818:0:(service.c:3206:ptlrpc_main()) ldlm_cb00_001: service thread [ffff914684f4aa00:5818] 1 exiting: rc = 0 00000100:00100000:0.0:1790946595.537997:0:8516:0:(service.c:3206:ptlrpc_main()) ldlm_cb00_003: service thread [ffff91468744f800:8516] 3 exiting: rc = 0 00000100:00100000:3.0:1790946595.541115:0:6689:0:(service.c:3206:ptlrpc_main()) ldlm_cb00_002: service thread [ffff914584ad6e00:6689] 2 exiting: rc = 0 00000100:00100000:0.0:1790946595.542354:0:5817:0:(service.c:3206:ptlrpc_main()) ldlm_cb00_000: service thread [ffff914684f4bc00:5817] 0 exiting: rc = 1 00000100:00100000:3.0:1790946595.542499:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946595.542858:0:5821:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_002: service thread [ffff914688a4ee00:5821] 2 exiting: rc = 0 00000100:00100000:0.0:1790946595.542909:0:5820:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_001: service thread [ffff91468773f200:5820] 1 exiting: rc = 0 00000100:00100000:3.0:1790946595.543666:0:13240:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_003: service thread [ffff914682f18600:13240] 3 exiting: rc = 0 00000100:00100000:0.0:1790946595.544375:0:5819:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9146aa767400:5819] 0 exiting: rc = 1 00000100:00100000:3.0:1790946595.544543:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.544554:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.544585:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.544593:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.544604:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.544613:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.544630:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.544638:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.544646:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.544653:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.544658:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.544665:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.544671:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.544689:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.544697:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.544705:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.544711:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.544718:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.544724:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.544729:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.544734:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.544740:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.544746:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.544752:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.544759:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.544764:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.544769:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.544774:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.544779:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.544785:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.544791:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.544797:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.544803:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.544808:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.544813:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.544930:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.544938:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.544953:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.544958:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.544963:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.544968:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.544974:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.544980:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.544985:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.544990:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.544996:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.545074:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.545082:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.545088:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.545093:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.545099:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.545104:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.545110:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.545116:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.545121:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.545126:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.545131:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.545136:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.545142:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.545147:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.545153:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.545159:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.545165:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.545171:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1790946595.549912:0:13389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790946595.549931:0:13389:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1790946595.549938:0:13389:0:(genops.c:885:class_export_put()) final put ffff9146a03b9000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1790946595.549944:0:13389:0:(genops.c:844:class_export_destroy()) destroying export ffff9146a03b9000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1790946595.549958:0:13389:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1790946595.550490:0:13389:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9145853b6000 1 00000020:00000080:3.0:1790946595.550500:0:13389:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x16e41aef93271b4e 00000020:00000080:3.0:1790946595.550521:0:13389:0:(genops.c:885:class_export_put()) final put ffff9145853b2000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1790946595.550778:0:13389:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1790946595.550785:0:13389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790946595.550792:0:13389:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1790946595.550797:0:13389:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff91469e0b99c0) has no exports 00000020:00000080:0.0:1790946595.551368:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9145853b2000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1790946595.579988:0:13389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790946595.580018:0:13389:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1790946595.580025:0:13389:0:(genops.c:885:class_export_put()) final put ffff9145853b3000/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1790946595.580030:0:13389:0:(genops.c:844:class_export_destroy()) destroying export ffff9145853b3000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1790946595.580038:0:13389:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1790946595.580834:0:13389:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9145853b7800 00000020:01000000:0.0:1790946595.580864:0:13389:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1790946595.580870:0:13389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790946595.580876:0:13389:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1790946595.580880:0:13389:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff914684fb3380) has no exports 00000020:00000080:0.0:1790946595.580915:0:13389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790946595.580924:0:13389:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1790946595.580928:0:13389:0:(genops.c:885:class_export_put()) final put ffff9146a03bb000/OSS_uuid 00000020:00000080:0.0:1790946595.580931:0:13389:0:(genops.c:844:class_export_destroy()) destroying export ffff9146a03bb000/OSS_uuid for OSS 00000020:01000000:0.0:1790946595.580943:0:13389:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1790946595.580977:0:5830:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1790946595.583586:0:6673:0:(service.c:3206:ptlrpc_main()) ll_ost00_000: service thread [ffff9146be626400:6673] 0 exiting: rc = 1 00000100:00100000:0.0:1790946595.585582:0:6674:0:(service.c:3206:ptlrpc_main()) ll_ost00_001: service thread [ffff9146be627800:6674] 1 exiting: rc = 0 00000100:00100000:0.0:1790946595.585731:0:6808:0:(service.c:3206:ptlrpc_main()) ll_ost00_003: service thread [ffff9146be7e3c00:6808] 3 exiting: rc = 0 00000100:00100000:0.0:1790946595.585799:0:12075:0:(service.c:3206:ptlrpc_main()) ll_ost00_004: service thread [ffff91468744e200:12075] 4 exiting: rc = 0 00000100:00100000:0.0:1790946595.585873:0:6675:0:(service.c:3206:ptlrpc_main()) ll_ost00_002: service thread [ffff9146b6025400:6675] 2 exiting: rc = 0 00000100:00100000:0.0:1790946595.586807:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946595.586837:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946595.586845:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946595.586853:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946595.586858:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946595.586864:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946595.586870:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946595.586875:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946595.586880:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946595.586886:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946595.586891:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946595.587478:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946595.587489:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946595.587695:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946595.587705:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946595.587711:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946595.587717:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946595.587722:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946595.587727:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946595.587732:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946595.587737:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946595.587742:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946595.587747:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946595.587753:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946595.587757:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946595.587763:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946595.587768:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946595.587773:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946595.587778:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946595.587784:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946595.587789:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946595.587824:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946595.587832:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946595.587839:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946595.587844:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946595.587849:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946595.587855:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946595.587861:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946595.587866:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946595.587871:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946595.587876:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946595.587882:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946595.587887:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946595.587892:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946595.587898:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946595.587903:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946595.587915:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946595.587927:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946595.587932:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946595.587938:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946595.587944:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946595.587949:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946595.587955:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946595.587961:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946595.587967:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946595.587972:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946595.587978:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946595.587983:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946595.587989:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946595.587994:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946595.588728:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946595.588740:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946595.588746:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946595.588765:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790946595.592419:0:6678:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9146b2402000:6678] 1 exiting: rc = 0 00000100:00100000:3.0:1790946595.594736:0:6676:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9146be627200:6676] 0 exiting: rc = 1 00000100:00100000:3.0:1790946595.594892:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.594901:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.594907:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.594912:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.594917:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.594922:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.594926:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.594931:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.594935:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.594940:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.594944:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.594948:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.594952:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.594957:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.594961:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.594965:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.594969:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.594973:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.594978:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.594982:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.594987:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.594991:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.594995:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.595494:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.595504:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.595510:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.595516:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.595522:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.595527:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.595549:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.595556:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.595569:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.595577:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.595587:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.595598:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.595604:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.595614:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.595620:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.595626:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.595632:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.595638:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.595644:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.595649:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.595655:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.595662:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.595668:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.595674:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.595684:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.595690:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.595695:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.595700:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.595705:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.595711:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.595716:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.595721:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.595725:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.595730:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.595735:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.595740:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.595744:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.595748:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.595754:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.595758:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.595764:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.598308:0:6681:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9146be627c00:6681] 2 exiting: rc = 0 00000100:00100000:0.0:1790946595.598417:0:6680:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9146a0a5d600:6680] 1 exiting: rc = 0 00000100:00100000:2.0:1790946595.601010:0:6679:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9146a0a5da00:6679] 0 exiting: rc = 1 00000100:00100000:3.0:1790946595.601150:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.601161:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.601168:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.601174:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.601180:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.601222:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.601231:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.601237:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.601244:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.601251:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.601258:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.601264:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.601271:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.601278:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.601286:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.601292:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.601299:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.601305:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.601311:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.601316:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.601322:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.601347:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.601372:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.601381:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.601390:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.601399:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.601406:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.601416:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.601423:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.601430:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.601437:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.601443:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.601449:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.601455:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.601475:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.601481:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.601487:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.601494:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.601503:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.601510:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.601518:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.601524:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.601531:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.601537:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.601544:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.601551:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.601578:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.601586:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.601592:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.601599:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.601606:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.601612:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.601618:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.601801:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.601808:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.601814:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.601883:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.601891:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.601897:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.601902:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.601907:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.601913:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.601920:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.601926:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946595.617940:0:6682:0:(service.c:3206:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9146be626e00:6682] 0 exiting: rc = 1 00000100:00100000:1.0:1790946595.617952:0:6683:0:(service.c:3206:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9146c13e5800:6683] 1 exiting: rc = 0 00000100:00100000:3.0:1790946595.618248:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.618258:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.618267:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.618275:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.618285:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.618307:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.618315:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.618325:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.618332:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.618350:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.618363:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.618369:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.618375:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.618381:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.618388:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.618393:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.618399:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.618405:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.618410:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.618416:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.618422:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.618427:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.618432:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.618438:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.618443:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.618449:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.618455:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.618460:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.618466:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.618472:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.618478:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.618482:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.618487:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.618492:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.618497:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.618503:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.618507:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.618513:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.618519:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.618525:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.618538:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.618543:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.618549:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.618556:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.618562:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.618568:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.618575:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.618581:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.618588:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.618596:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.618602:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.618608:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.618613:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.618618:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.618623:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.618629:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.618634:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.618638:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.618643:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.618648:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.618653:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.618657:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.618663:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790946595.618672:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790946595.620819:0:6685:0:(service.c:3206:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9146c13e5400:6685] 1 exiting: rc = 0 00000100:00100000:0.0:1790946595.620992:0:6684:0:(service.c:3206:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9146c13e4c00:6684] 0 exiting: rc = 1 00000100:00100000:1.0:1790946595.622334:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946595.622355:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946595.622378:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946595.622388:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946595.622394:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946595.622403:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946595.622412:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946595.622419:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946595.622426:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946595.622447:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946595.622455:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946595.622463:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946595.622470:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946595.622476:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946595.622483:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946595.622505:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946595.622514:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946595.622521:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946595.622529:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946595.622537:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946595.622577:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946595.622585:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946595.622596:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946595.622603:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946595.622610:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946595.622617:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946595.622623:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946595.622647:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946595.622655:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946595.622662:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946595.622668:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946595.622675:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946595.622681:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946595.622687:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946595.622694:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946595.622701:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946595.622708:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946595.622716:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946595.622721:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946595.622742:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946595.622750:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946595.622758:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946595.622764:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946595.622772:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946595.622785:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946595.622795:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946595.622802:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946595.622811:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946595.622817:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946595.622825:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946595.622833:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946595.622857:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946595.622864:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946595.622870:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946595.622877:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946595.622883:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946595.622889:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946595.622896:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946595.622903:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946595.622910:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946595.622916:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946595.622923:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946595.622933:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790946595.622942:0:13389:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1790946595.643671:0:13389:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1790946612.492010:0:14005:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1790946621.539649:0:14468:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1790946621.539655:0:14468:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1790946621.539773:0:14468:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff914586f39800 00000020:01000004:2.0:1790946621.539789:0:14468:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1790946621.539797:0:14468:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1790946621.539826:0:14468:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff914684fb3380) 00000020:00000080:2.0:1790946621.539841:0:14468:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1790946621.563946:0:14468:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1790946621.566998:0:14468:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1790946621.567531:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:2.0:1790946621.567643:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:2.0:1790946621.567993:0:14468:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1790946621.568062:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:2.0:1790946621.568369:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:2.0:1790946621.568544:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:2.0:1790946621.568628:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:2.0:1790946621.569027:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:2.0:1790946621.574178:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 471: rc = 0 00100000:10000000:2.0:1790946621.574388:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 471: rc = 0 00100000:10000000:2.0:1790946621.575880:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 639: rc = 0 00100000:10000000:2.0:1790946621.576614:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 639: rc = 0 00100000:10000000:2.0:1790946621.577032:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 639: rc = 0 00100000:10000000:2.0:1790946621.577596:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 639: rc = 0 00100000:10000000:2.0:1790946621.578018:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 639: rc = 0 00100000:10000000:2.0:1790946621.578513:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 639: rc = 0 00100000:10000000:2.0:1790946621.578911:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 639: rc = 0 00100000:10000000:2.0:1790946621.579168:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 639: rc = 0 00100000:10000000:2.0:1790946621.579791:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 639: rc = 0 00100000:10000000:2.0:1790946621.581094:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 639: rc = 0 00100000:10000000:2.0:1790946621.581774:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 639: rc = 0 00100000:10000000:2.0:1790946621.582063:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 639: rc = 0 00100000:10000000:2.0:1790946621.582597:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 770: rc = 0 00100000:10000000:2.0:1790946621.582962:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 770: rc = 0 00100000:10000000:2.0:1790946621.583193:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 770: rc = 0 00100000:10000000:2.0:1790946621.584127:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 770: rc = 0 00100000:10000000:2.0:1790946621.587172:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 770: rc = 0 00100000:10000000:2.0:1790946621.588935:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 770: rc = 0 00100000:10000000:2.0:1790946621.589271:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 770: rc = 0 00100000:10000000:2.0:1790946621.589645:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 770: rc = 0 00100000:10000000:2.0:1790946621.589884:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 770: rc = 0 00100000:10000000:2.0:1790946621.590159:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 770: rc = 0 00100000:10000000:2.0:1790946621.591017:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 770: rc = 0 00100000:10000000:3.0:1790946621.592072:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 770: rc = 0 00100000:10000000:3.0:1790946621.592996:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 770: rc = 0 00100000:10000000:3.0:1790946621.593570:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 770: rc = 0 00100000:10000000:3.0:1790946621.593990:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 770: rc = 0 00100000:10000000:3.0:1790946621.594539:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 770: rc = 0 00100000:10000000:3.0:1790946621.594944:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 770: rc = 0 00100000:10000000:3.0:1790946621.595619:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 770: rc = 0 00100000:10000000:3.0:1790946621.596041:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 770: rc = 0 00100000:10000000:3.0:1790946621.596480:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 770: rc = 0 00100000:10000000:3.0:1790946621.596801:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 770: rc = 0 00100000:10000000:3.0:1790946621.597136:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 770: rc = 0 00100000:10000000:3.0:1790946621.600958:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 770: rc = 0 00100000:10000000:3.0:1790946621.601322:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 770: rc = 0 00100000:10000000:3.0:1790946621.601601:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 770: rc = 0 00100000:10000000:3.0:1790946621.601847:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 770: rc = 0 00100000:10000000:3.0:1790946621.602096:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 770: rc = 0 00100000:10000000:3.0:1790946621.604573:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 770: rc = 0 00100000:10000000:3.0:1790946621.605524:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 770: rc = 0 00100000:10000000:3.0:1790946621.613050:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 770: rc = 0 00100000:10000000:3.0:1790946621.614338:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 770: rc = 0 00100000:10000000:3.0:1790946621.614643:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 770: rc = 0 00100000:10000000:3.0:1790946621.615629:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 475: rc = 0 00100000:10000000:3.0:1790946621.617054:0:14468:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1790946621.617347:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 636: rc = 0 00100000:10000000:3.0:1790946621.617680:0:14468:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1790946621.617750:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 636: rc = 0 00100000:10000000:3.0:1790946621.618112:0:14468:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1790946621.618197:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 636: rc = 0 00100000:10000000:3.0:1790946621.620720:0:14468:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1790946621.620948:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 472: rc = 0 00100000:10000000:3.0:1790946621.621157:0:14468:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1790946621.621330:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 472: rc = 0 00100000:10000000:3.0:1790946621.621676:0:14468:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1790946621.621744:0:14468:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 472: rc = 0 00000020:00000080:3.0:1790946621.622123:0:14468:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1790946621.622136:0:14468:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1790946621.622154:0:14468:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x16e41aef93272c65 00000020:01000004:3.0:1790946621.622162:0:14468:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1790946621.622167:0:14468:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1790946621.622172:0:14468:0:(tgt_mount.c:101:server_register_mount()) register mount ffff914586f39800 from MGS 00000020:01000004:3.0:1790946621.622177:0:14468:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1790946621.622186:0:14468:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff91469e0b99c0) 00000020:00000080:3.0:1790946621.622196:0:14468:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1790946621.622540:0:14468:0:(tgt_mount.c:153:server_get_mount()) get mount ffff914586f39800 from MGS, refs=2 00080000:01000000:3.0:1790946621.622546:0:14468:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1790946621.622552:0:14468:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x16e41aef93272c73 00000100:00100000:3.0:1790946621.622646:0:14468:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1790946621.622764:0:14468:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1790946621.622784:0:14468:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1790946621.624095:0:14468:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1790946621.624107:0:14468:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1790946621.628616:0:14468:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790946621.628803:0:14468:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1790946621.628924:0:14468:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1790946621.629710:0:14468:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1790946621.629718:0:14468:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1790946621.632690:0:14468:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1790946621.632708:0:14468:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1790946621.634014:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946621.634018:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946621.634019:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946621.635937:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946621.635943:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946621.635945:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946621.636785:0:14468:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1790946621.639369:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1790946621.658639:0:14468:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1790946621.658656:0:14468:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1790946621.658659:0:14468:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1790946621.661386:0:14477:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1790946621.661648:0:14468:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1790946621.661759:0:14468:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1790946621.662984:0:14468:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1790946621.663552:0:14468:0:(service.c:173:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790946621.663884:0:14468:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1790946621.663891:0:14468:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1790946621.673292:0:14468:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1790946621.673308:0:14468:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1790946621.686023:0:14468:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1790946621.686037:0:14468:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1790946621.687867:0:14468:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1790946621.687891:0:14468:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.113@tcp' 00000020:01000004:0.0:1790946621.687893:0:14468:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1790946621.688149:0:14468:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.113@tcp (typ=mgc) 00000020:00000080:0.0:1790946621.688163:0:14468:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.113@tcp (ffff9146849dcd40) 00000020:00000080:0.0:1790946621.688178:0:14468:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1790946621.688314:0:14468:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9146beb35800@MGC192.168.203.113@tcp: add connection 192.168.203.113@tcp at head 00010000:00010000:0.0:1790946621.688539:0:14468:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.113@tcp-0 is initialized 00000040:01000000:0.0:1790946621.688546:0:14468:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.113@tcp ctxt 1 is initialized 00000100:00080000:3.0:1790946621.693792:0:14482:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1790946621.694487:0:14483:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1790946621.694649:0:14468:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.113@tcp (uuid 0b106ef3-c5bc-477a-ab83-2c0856d82eb3) 00000020:00000080:0.0:1790946621.694734:0:14468:0:(genops.c:1384:class_connect()) connect: client 0b106ef3-c5bc-477a-ab83-2c0856d82eb3, cookie 0x16e41aef93272c81 00000100:00080000:0.0:1790946621.694749:0:14468:0:(import.c:545:import_select_connection()) MGC192.168.203.113@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790946621.694761:0:14468:0:(import.c:666:import_select_connection()) MGC192.168.203.113@tcp: import ffff9146beb35800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:0.0:1790946621.694797:0:14468:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9146be98e300 x1877943303362560/t0(0) o250->MGC192.168.203.113@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790946621.694908:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be98e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:3299:1877943303362560:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1790946621.694967:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1790946621.695023:0:14468:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 0b106ef3-c5bc-477a-ab83-2c0856d82eb3->MGS 00000020:01000004:0.0:1790946621.695038:0:14468:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1790946621.695043:0:14468:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1790946621.695056:0:14468:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9146849d99c0) 00000020:00000080:0.0:1790946621.695069:0:14468:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1790946621.695102:0:14478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303362560 00000100:00100000:3.0:1790946621.695110:0:14478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303362560 00000100:00100000:3.0:1790946621.695154:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790946621.695164:0:14478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3299:x1877943303362560:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1790946621.695189:0:14478:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 0b106ef3-c5bc-477a-ab83-2c0856d82eb3@0@lo t0 exp 0000000000000000 cur 406 last 0 00000020:00000080:3.0:1790946621.695234:0:14478:0:(genops.c:1384:class_connect()) connect: client 0b106ef3-c5bc-477a-ab83-2c0856d82eb3, cookie 0x16e41aef93272c8f 00000100:00080000:3.0:1790946621.695778:0:14478:0:(import.c:65:import_set_state_nolock()) ffff9145853b6000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790946621.695847:0:14478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+5:3299:x1877943303362560:12345-0@lo:250:mount.lustre.0 Request processed in 684us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946621.695855:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790946621.696784:0:3299:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.113@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1790946621.696794:0:3299:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.113@tcp: connect to target with instance 0 00000100:00080000:2.0:1790946621.696802:0:3299:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.113@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1790946621.696865:0:3299:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1790946621.696870:0:3299:0:(import.c:65:import_set_state_nolock()) ffff9146beb35800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1790946621.696873:0:3299:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1790946621.696883:0:3299:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1790946621.696891:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be98e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:3299:1877943303362560:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1790946621.708306:0:14468:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790946621.709101:0:14468:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1790946621.709109:0:14468:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1790946621.710751:0:14468:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1790946621.714050:0:14468:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1790946621.717780:0:14468:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1790946621.717794:0:14468:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1790946621.723134:0:14468:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790946621.723373:0:14468:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1790946621.723379:0:14468:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1790946621.725783:0:14468:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1790946621.725804:0:14468:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1790946621.806954:0:14468:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790946621.807194:0:14468:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1790946621.807234:0:14468:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1790946621.813574:0:14468:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1790946621.813599:0:14468:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1790946621.819537:0:14468:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790946621.819809:0:14468:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1790946621.819815:0:14468:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1790946621.823301:0:14468:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1790946621.823313:0:14468:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1790946621.824614:0:14468:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790946621.824806:0:14468:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1790946621.824812:0:14468:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1790946621.826899:0:14468:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1790946621.826927:0:14468:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1790946621.829339:0:14468:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790946621.829615:0:14468:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1790946621.829621:0:14468:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1790946621.841052:0:14468:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790946621.841065:0:14468:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1790946621.878981:0:14468:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790946621.879284:0:14468:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1790946621.879292:0:14468:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1790946621.885099:0:14468:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1790946621.885112:0:14468:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1790946621.890093:0:14468:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1790946621.890112:0:14468:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1790946621.891862:0:14468:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1790946621.891893:0:14468:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1790946621.891899:0:14468:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.113@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1790946621.892047:0:14468:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.113@tcp ctxt 0 is initialized 00000020:01000004:0.0:1790946621.892100:0:14468:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.113@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1790946621.892104:0:14468:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1790946621.892106:0:14468:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790946621.892107:0:14468:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790946621.892108:0:14468:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790946621.892109:0:14468:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790946621.892110:0:14468:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790946621.892112:0:14468:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790946621.892113:0:14468:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790946621.892115:0:14468:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790946621.892117:0:14468:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790946621.892119:0:14468:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1790946621.892121:0:14468:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790946621.892123:0:14468:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790946621.892124:0:14468:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790946621.892125:0:14468:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790946621.892126:0:14468:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790946621.892127:0:14468:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790946621.892128:0:14468:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790946621.892129:0:14468:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790946621.892135:0:14468:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790946621.892136:0:14468:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790946621.892175:0:14468:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1790946621.892197:0:14468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be98e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14468:1877943303362688:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1790946621.892954:0:14468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946621.893098:0:14468:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146863d3240 going to sleep for 11 seconds 00000100:00100000:1.0:1790946621.893775:0:14481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303362688 00000100:00100000:1.0:1790946621.893784:0:14481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303362688 00000100:00100000:1.0:1790946621.893906:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790946621.893916:0:14481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+5:14468:x1877943303362688:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1790946621.893982:0:14481:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1790946621.893986:0:14481:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1790946621.893989:0:14481:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1790946621.896810:0:14502:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1790946621.897230:0:14481:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:1.0:1790946621.903651:0:14503:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1790946621.903659:0:14503:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1790946621.903661:0:14503:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1790946621.903693:0:14503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:3.0:1790946621.904629:0:14481:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1790946621.904644:0:14481:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1790946621.926073:0:14481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+5:14468:x1877943303362688:12345-0@lo:253:mount.lustre.0 Request processed in 32149us (33110us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946621.926091:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790946621.926509:0:14468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be98e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14468:1877943303362688:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790946621.926525:0:14468:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1790946621.926529:0:14468:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790946621.926530:0:14468:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790946621.926532:0:14468:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790946621.926533:0:14468:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790946621.926534:0:14468:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790946621.926535:0:14468:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790946621.926537:0:14468:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790946621.926538:0:14468:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790946621.926540:0:14468:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790946621.926542:0:14468:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1790946621.926563:0:14468:0:(tgt_mount.c:101:server_register_mount()) register mount ffff914586f39800 from lustre-MDT0000 10000000:01000000:2.0:1790946621.926590:0:14468:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1790946621.926593:0:14468:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1790946621.926597:0:14468:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9146849dcd40 10000000:01000000:2.0:1790946621.926601:0:14468:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790946621.926608:0:14468:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9146849dcd40 from 1 10000000:01000000:2.0:1790946621.926611:0:14468:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1790946621.926647:0:14468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff914688aef000/0x16e41aef93272c96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946621.926657:0:14468:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff914688aef000/0x16e41aef93272c96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946621.926666:0:14468:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff914688aef000/0x16e41aef93272c96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946621.926697:0:14468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5a6b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14468:1877943303362816:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790946621.927410:0:14468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946621.928596:0:14480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303362816 00000100:00100000:3.0:1790946621.928608:0:14480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303362816 00000100:00100000:3.0:1790946621.928665:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790946621.928675:0:14480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+5:14468:x1877943303362816:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790946621.928691:0:14480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946621.928710:0:14480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9146be9f7400/0x16e41aef93272c9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x16e41aef93272c96 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946621.928736:0:14480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9146be9f7400/0x16e41aef93272c9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x16e41aef93272c96 expref: 6 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946621.928747:0:14480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9146be9f7400/0x16e41aef93272c9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93272c96 expref: 6 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946621.928761:0:14480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146be9f7400, rc 0) 00000100:00100000:3.0:1790946621.928821:0:14480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+6:14468:x1877943303362816:12345-0@lo:101:mount.lustre.0 Request processed in 149us (1413us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946621.928990:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790946621.929047:0:14468:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146b602ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1790946621.929072:0:14468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5a6b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14468:1877943303362816:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790946621.929091:0:14468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff914688aef000/0x16e41aef93272c96 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93272c9d expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946621.929101:0:14468:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff914688aef000/0x16e41aef93272c96 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93272c9d expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946621.929194:0:14468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914698016300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14468:1877943303362944:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790946621.929243:0:14468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946621.929271:0:14468:0:(client.c:2716:ptlrpc_set_wait()) set ffff914682f3d300 going to sleep for 11 seconds 00000100:00100000:0.0:1790946621.929369:0:14481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303362944 00000100:00100000:0.0:1790946621.929374:0:14481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303362944 00000100:00100000:0.0:1790946621.929416:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790946621.929424:0:14481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+6:14468:x1877943303362944:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790946621.929669:0:14481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+6:14468:x1877943303362944:12345-0@lo:501:mount.lustre.0 Request processed in 245us (425us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790946621.929676:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790946621.929792:0:14468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914698016300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14468:1877943303362944:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1790946621.929817:0:14468:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1790946621.929837:0:14468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff914688aef000/0x16e41aef93272c96 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93272c9d expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946621.929846:0:14468:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff914688aef000/0x16e41aef93272c96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93272c9d expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790946621.929854:0:14468:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff914586f39800 10000000:01000000:3.0:1790946621.929860:0:14468:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1790946621.929864:0:14468:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff914586f39800 10000000:01000000:3.0:1790946621.929867:0:14468:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1790946621.929870:0:14468:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff914586f39800 from 1 10000000:01000000:3.0:1790946621.929872:0:14468:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1790946621.929894:0:14468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146be9f6200/0x16e41aef93272ca4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946621.929902:0:14468:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9146be9f6200/0x16e41aef93272ca4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946621.929911:0:14468:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9146be9f6200/0x16e41aef93272ca4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946621.929924:0:14468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914698016300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14468:1877943303363072:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790946621.929960:0:14468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946621.930106:0:14468:0:(client.c:2716:ptlrpc_set_wait()) set ffff914682f3d300 going to sleep for 11 seconds 00000100:00100000:0.0:1790946621.935675:0:14480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303363072 00000100:00100000:0.0:1790946621.935691:0:14480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303363072 00000100:00100000:0.0:1790946621.935968:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790946621.935980:0:14480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+6:14468:x1877943303363072:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790946621.936001:0:14480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946621.936028:0:14480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9146b1932400/0x16e41aef93272cab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x16e41aef93272ca4 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946621.936056:0:14480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9146b1932400/0x16e41aef93272cab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x16e41aef93272ca4 expref: 7 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946621.936068:0:14480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9146b1932400/0x16e41aef93272cab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93272ca4 expref: 7 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946621.936095:0:14480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b1932400, rc 0) 00000100:00100000:0.0:1790946621.936536:0:14480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+7:14468:x1877943303363072:12345-0@lo:101:mount.lustre.0 Request processed in 556us (6572us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946621.936545:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790946621.937594:0:14468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914698016300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14468:1877943303363072:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790946621.937623:0:14468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9146be9f6200/0x16e41aef93272ca4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93272cab expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946621.937639:0:14468:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9146be9f6200/0x16e41aef93272ca4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93272cab expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790946621.937660:0:14468:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1790946621.937681:0:14468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146be9f6200/0x16e41aef93272ca4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93272cab expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946621.937689:0:14468:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9146be9f6200/0x16e41aef93272ca4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93272cab expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790946621.937698:0:14468:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1790946621.937747:0:14468:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790946621.937755:0:14468:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff914586f39800 10000000:01000000:3.0:1790946621.937758:0:14468:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1790946621.937763:0:14468:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1790946621.937765:0:14468:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1790946621.937796:0:14468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146be9f6000/0x16e41aef93272cb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946621.937804:0:14468:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9146be9f6000/0x16e41aef93272cb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946621.937825:0:14468:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9146be9f6000/0x16e41aef93272cb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946621.937859:0:14468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914698016300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14468:1877943303363200:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790946621.937909:0:14468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946621.937954:0:14468:0:(client.c:2716:ptlrpc_set_wait()) set ffff914682f3d300 going to sleep for 11 seconds 00000100:00100000:0.0:1790946621.938133:0:14481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303363200 00000100:00100000:0.0:1790946621.938150:0:14481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303363200 00000100:00100000:0.0:1790946621.938235:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790946621.938244:0:14481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+7:14468:x1877943303363200:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790946621.938256:0:14481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946621.938269:0:14481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9146b1933a00/0x16e41aef93272cb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x16e41aef93272cb2 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946621.938287:0:14481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9146b1933a00/0x16e41aef93272cb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x16e41aef93272cb2 expref: 8 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946621.938298:0:14481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9146b1933a00/0x16e41aef93272cb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93272cb2 expref: 8 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946621.938306:0:14481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b1933a00, rc 0) 00000100:00100000:0.0:1790946621.938351:0:14481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+8:14468:x1877943303363200:12345-0@lo:101:mount.lustre.0 Request processed in 109us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946621.938358:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790946621.941328:0:14468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914698016300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14468:1877943303363200:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790946621.941357:0:14468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9146be9f6000/0x16e41aef93272cb2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93272cb9 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946621.941369:0:14468:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9146be9f6000/0x16e41aef93272cb2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93272cb9 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946621.941905:0:14468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914698016300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14468:1877943303363328:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790946621.941967:0:14468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946621.942014:0:14468:0:(client.c:2716:ptlrpc_set_wait()) set ffff914682f3d300 going to sleep for 11 seconds 00000100:00100000:2.0:1790946621.942117:0:14481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303363328 00000100:00100000:2.0:1790946621.942125:0:14481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303363328 00000100:00100000:2.0:1790946621.942182:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790946621.942191:0:14481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468872b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+8:14468:x1877943303363328:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790946621.942759:0:14481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468872b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+9:14468:x1877943303363328:12345-0@lo:501:mount.lustre.0 Request processed in 568us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946621.942768:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790946621.942921:0:14468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914698016300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14468:1877943303363328:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790946621.942958:0:14468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914698016300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14468:1877943303363456:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790946621.943001:0:14468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946621.943029:0:14478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303363456 00000100:00100000:3.0:1790946621.943034:0:14478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303363456 00000100:00100000:3.0:1790946621.943060:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790946621.943068:0:14478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914688728c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+9:14468:x1877943303363456:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790946621.945309:0:14468:0:(client.c:2716:ptlrpc_set_wait()) set ffff914682f3d300 going to sleep for 11 seconds 00000100:00100000:2.0:1790946621.945346:0:14468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914698016300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14468:1877943303363456:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790946621.946049:0:14504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5a6a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14504:1877943303363584:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790946621.946113:0:14504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946621.946154:0:14504:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146b602c600 going to sleep for 11 seconds 00000100:00100000:1.0:1790946621.946230:0:14480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303363584 00000100:00100000:1.0:1790946621.946237:0:14480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303363584 00000100:00100000:1.0:1790946621.946282:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790946621.946291:0:14480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914688729850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+10:14504:x1877943303363584:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790946621.946412:0:14478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914688728c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+10:14468:x1877943303363456:12345-0@lo:503:mount.lustre.0 Request processed in 2128us (2194us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946621.947498:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790946621.948611:0:14480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914688729850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+9:14504:x1877943303363584:12345-0@lo:502:llog_process_th.0 Request processed in 2317us (2493us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946621.948624:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790946621.957007:0:14504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5a6a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14504:1877943303363584:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790946621.957066:0:14504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790946621.957079:0:14504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946621.957083:0:14504:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1790946621.957089:0:14504:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1790946621.957091:0:14504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790946621.957111:0:14504:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff914684fb4d40) 00000020:00000080:2.0:1790946621.957132:0:14504:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1790946621.957136:0:14504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1790946621.957635:0:14504:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:2.0:1790946621.957643:0:14504:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x16e41aef93272cc7 00000020:00000080:2.0:1790946621.958017:0:14504:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1790946621.958036:0:14504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790946621.958041:0:14504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946621.958042:0:14504:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1790946621.958046:0:14504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790946621.958049:0:14504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946621.958050:0:14504:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1790946621.958053:0:14504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790946621.958062:0:14504:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff914684fb0000) 00000020:00000080:2.0:1790946621.958073:0:14504:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1790946621.958078:0:14504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1790946621.958080:0:14504:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1790946621.958083:0:14504:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1790946621.958088:0:14504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1790946621.958160:0:14504:0:(tgt_mount.c:153:server_get_mount()) get mount ffff914586f39800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1790946621.958173:0:14504:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff914684fb19c0) 00000020:00000080:2.0:1790946621.958182:0:14504:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1790946621.958490:0:14504:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1790946621.958497:0:14504:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x16e41aef93272cdc 00000020:00000080:2.0:1790946621.958601:0:14504:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1790946621.958608:0:14504:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1790946621.958612:0:14504:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x16e41aef93272ce3 00080000:01000000:2.0:1790946621.958618:0:14504:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:2.0:1790946621.958621:0:14504:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x16e41aef93272cea 00010000:00010000:2.0:1790946622.075380:0:14504:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1790946622.079197:0:14504:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967527 00000001:00080000:2.0:1790946622.079476:0:14504:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1790946622.081375:0:14504:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff91468e3e3380) 00000020:00000080:2.0:1790946622.081398:0:14504:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1790946622.081484:0:14504:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1790946622.081494:0:14504:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x16e41aef93272cf8 00000020:00000080:3.0:1790946622.086888:0:14504:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1790946622.093329:0:14504:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x16e41aef93272cff 00000020:00000080:2.0:1790946622.094047:0:14504:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1790946622.094059:0:14504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790946622.094072:0:14504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946622.094074:0:14504:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1790946622.094078:0:14504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1790946622.094081:0:14504:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1790946622.094083:0:14504:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790946622.094084:0:14504:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790946622.094085:0:14504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1790946622.094088:0:14504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946622.094090:0:14504:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1790946622.094092:0:14504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790946622.094097:0:14504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946622.094099:0:14504:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1790946622.094104:0:14504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1790946622.094155:0:14504:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1790946622.094169:0:14504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790946622.094173:0:14504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946622.094174:0:14504:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1790946622.094177:0:14504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790946622.094180:0:14504:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1790946622.094183:0:14504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946622.094185:0:14504:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1790946622.094188:0:14504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1790946622.094193:0:14504:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.113@tcp to nid 0x20000c0a8cb71 (192.168.203.113@tcp) 00000020:01000000:2.0:1790946622.094252:0:14504:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1790946622.094255:0:14504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790946622.094270:0:14504:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff91468e3e0000) 00000020:00000080:2.0:1790946622.094284:0:14504:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1790946622.094288:0:14504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1790946622.094337:0:14504:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1790946622.094343:0:14504:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:2.0:1790946622.094349:0:14504:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x16e41aef93272d0d 00010000:00080000:2.0:1790946622.094378:0:14504:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9146b581e800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.113@tcp at head 00010000:00010000:2.0:1790946622.095085:0:14504:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1790946622.096062:0:14504:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1790946622.096408:0:14504:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1790946622.097379:0:14504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790946622.097439:0:14504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1790946622.097505:0:14504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1790946622.105280:0:14508:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1790946622.105287:0:14508:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1790946622.109116:0:14504:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790946622.109130:0:14504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1790946622.109172:0:14504:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1790946622.109191:0:14504:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x16e41aef93272d14 00000100:00080000:2.0:1790946622.109230:0:14504:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790946622.109241:0:14504:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9146b581e800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:2.0:1790946622.109278:0:14504:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9146b5a6a680 x1877943303363712/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790946622.109302:0:14504:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1790946622.109350:0:14504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790946622.109354:0:14504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946622.109356:0:14504:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1790946622.109359:0:14504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1790946622.109362:0:14504:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:2.0:1790946622.109364:0:14504:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790946622.109365:0:14504:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790946622.109366:0:14504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1790946622.109369:0:14504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946622.109370:0:14504:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:2.0:1790946622.109373:0:14504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790946622.109376:0:14504:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1790946622.109380:0:14504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946622.109381:0:14504:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1790946622.109385:0:14504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1790946622.109390:0:14504:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.113@tcp to nid 0x20000c0a8cb71 (192.168.203.113@tcp) 00000020:01000000:2.0:1790946622.109409:0:14504:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1790946622.109412:0:14504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790946622.109424:0:14504:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff91468e3e19c0) 00000020:00000080:2.0:1790946622.109436:0:14504:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1790946622.109441:0:14504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1790946622.109489:0:14504:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1790946622.109503:0:14504:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:2.0:1790946622.109508:0:14504:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x16e41aef93272d22 00010000:00080000:2.0:1790946622.109532:0:14504:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9146851e9000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.113@tcp at head 00010000:00010000:2.0:1790946622.109812:0:14504:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1790946622.109991:0:14504:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1790946622.110015:0:14504:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1790946622.110534:0:14504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790946622.110743:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5a6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1877943303363712:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1790946622.110800:0:3299:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877943303363712 offset 0 length 520: 4 00000040:00080000:2.0:1790946622.111434:0:14504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1790946622.111529:0:14504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1790946622.113532:0:14510:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1790946622.113551:0:14510:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1790946622.114588:0:14504:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790946622.114611:0:14504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1790946622.114642:0:14504:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1790946622.114660:0:14504:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x16e41aef93272d29 00000100:00080000:2.0:1790946622.114669:0:14504:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790946622.114679:0:14504:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9146851e9000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:2.0:1790946622.114712:0:14504:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9146b5a6ad80 x1877943303363840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790946622.114742:0:14504:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1790946622.114797:0:14504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790946622.114801:0:14504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946622.114803:0:14504:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1790946622.114806:0:14504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790946622.114810:0:14504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946622.114811:0:14504:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790946622.114815:0:14504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790946622.114816:0:14504:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1790946622.114819:0:14504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790946622.114821:0:14504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946622.114822:0:14504:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:2.0:1790946622.114825:0:14504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790946622.114827:0:14504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946622.114833:0:14504:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1790946622.114838:0:14504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1790946622.114868:0:14504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5a69180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14504:1877943303363968:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790946622.114942:0:14504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946622.114985:0:14504:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146b602cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1790946622.115124:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5a6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1877943303363840:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1790946622.115166:0:3299:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877943303363840 offset 0 length 520: 4 00000100:00100000:0.0:1790946622.116396:0:14478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303363968 00000100:00100000:0.0:1790946622.116409:0:14478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303363968 00000100:00100000:0.0:1790946622.116476:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790946622.116485:0:14478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914688728450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+9:14504:x1877943303363968:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790946622.116779:0:14478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914688728450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+9:14504:x1877943303363968:12345-0@lo:502:llog_process_th.0 Request processed in 294us (1836us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946622.116787:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790946622.116886:0:14504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5a69180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14504:1877943303363968:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790946622.116920:0:14504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790946622.116927:0:14504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790946622.116929:0:14504:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1790946622.116933:0:14504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1790946622.117323:0:14468:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1790946622.117343:0:14468:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1790946622.117355:0:14468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146be9f6000/0x16e41aef93272cb2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93272cb9 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946622.117366:0:14468:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9146be9f6000/0x16e41aef93272cb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93272cb9 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790946622.117374:0:14468:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff914586f39800 from 1 10000000:01000000:0.0:1790946622.117377:0:14468:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790946622.117411:0:14468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146b1933400/0x16e41aef93272d30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946622.117420:0:14468:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9146b1933400/0x16e41aef93272d30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946622.117438:0:14468:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9146b1933400/0x16e41aef93272d30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946622.117456:0:14468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be98ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14468:1877943303364096:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790946622.117489:0:14468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946622.117521:0:14468:0:(client.c:2716:ptlrpc_set_wait()) set ffff914586872000 going to sleep for 11 seconds 00000100:00100000:1.0:1790946622.117573:0:14480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303364096 00000100:00100000:1.0:1790946622.117578:0:14480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303364096 00000100:00100000:1.0:1790946622.117616:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790946622.117623:0:14480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468872bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+9:14468:x1877943303364096:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790946622.117633:0:14480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946622.117646:0:14480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9146b180ee00/0x16e41aef93272d37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x16e41aef93272d30 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946622.117665:0:14480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9146b180ee00/0x16e41aef93272d37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x16e41aef93272d30 expref: 10 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946622.117674:0:14480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9146b180ee00/0x16e41aef93272d37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93272d30 expref: 10 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946622.117683:0:14480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b180ee00, rc 0) 00000100:00100000:1.0:1790946622.117718:0:14480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468872bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+10:14468:x1877943303364096:12345-0@lo:101:mount.lustre.0 Request processed in 96us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946622.117724:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790946622.118881:0:14468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be98ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14468:1877943303364096:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790946622.118905:0:14468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9146b1933400/0x16e41aef93272d30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93272d37 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946622.118917:0:14468:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9146b1933400/0x16e41aef93272d30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93272d37 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946622.119490:0:14468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be98ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14468:1877943303364224:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1790946622.119549:0:14468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946622.119585:0:14468:0:(client.c:2716:ptlrpc_set_wait()) set ffff914586872000 going to sleep for 11 seconds 00000100:00100000:1.0:1790946622.119776:0:14480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303364224 00000100:00100000:1.0:1790946622.119783:0:14480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303364224 00000100:00100000:1.0:1790946622.119832:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790946622.119839:0:14480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468872a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+10:14468:x1877943303364224:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1790946622.119857:0:14480:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1790946622.119871:0:14480:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1790946622.120725:0:14480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468872a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+10:14468:x1877943303364224:12345-0@lo:256:mount.lustre.0 Request processed in 883us (1173us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946622.120736:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790946622.120802:0:14468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be98ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14468:1877943303364224:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1790946622.126359:0:14468:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790946622.126421:0:14468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146b1933400/0x16e41aef93272d30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93272d37 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946622.126441:0:14468:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9146b1933400/0x16e41aef93272d30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93272d37 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790946622.126450:0:14468:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff914586f39800 from 1 10000000:01000000:0.0:1790946622.126453:0:14468:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790946622.126495:0:14468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146b1932a00/0x16e41aef93272d3e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946622.126504:0:14468:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9146b1932a00/0x16e41aef93272d3e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946622.126515:0:14468:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9146b1932a00/0x16e41aef93272d3e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946622.126555:0:14468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be98ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14468:1877943303364352:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790946622.126627:0:14468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946622.126670:0:14468:0:(client.c:2716:ptlrpc_set_wait()) set ffff914586872000 going to sleep for 11 seconds 00000100:00100000:1.0:1790946622.126739:0:14481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303364352 00000100:00100000:1.0:1790946622.126747:0:14481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303364352 00000100:00100000:1.0:1790946622.126792:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790946622.126801:0:14481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914688728050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+10:14468:x1877943303364352:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790946622.126814:0:14481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946622.126828:0:14481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9146b180f000/0x16e41aef93272d45 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x16e41aef93272d3e expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946622.126850:0:14481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9146b180f000/0x16e41aef93272d45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x16e41aef93272d3e expref: 11 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946622.126861:0:14481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9146b180f000/0x16e41aef93272d45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93272d3e expref: 11 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946622.126870:0:14481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b180f000, rc 0) 00000100:00100000:1.0:1790946622.126910:0:14481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914688728050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+11:14468:x1877943303364352:12345-0@lo:101:mount.lustre.0 Request processed in 109us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946622.126917:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790946622.127191:0:14468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be98ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14468:1877943303364352:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790946622.127241:0:14468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9146b1932a00/0x16e41aef93272d3e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93272d45 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946622.127250:0:14468:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9146b1932a00/0x16e41aef93272d3e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93272d45 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946622.127300:0:14468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be98ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14468:1877943303364480:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790946622.127326:0:14468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946622.127343:0:14468:0:(client.c:2716:ptlrpc_set_wait()) set ffff914586872000 going to sleep for 11 seconds 00000100:00100000:1.0:1790946622.127393:0:14480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303364480 00000100:00100000:1.0:1790946622.127398:0:14480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303364480 00000100:00100000:1.0:1790946622.127435:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790946622.127442:0:14480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b583c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+11:14468:x1877943303364480:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790946622.127817:0:14480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b583c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+11:14468:x1877943303364480:12345-0@lo:501:mount.lustre.0 Request processed in 374us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946622.127826:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790946622.128006:0:14468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be98ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14468:1877943303364480:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790946622.128035:0:14468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be98ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14468:1877943303364608:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790946622.128075:0:14468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946622.128102:0:14468:0:(client.c:2716:ptlrpc_set_wait()) set ffff914586872000 going to sleep for 11 seconds 00000100:00100000:1.0:1790946622.129063:0:14478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303364608 00000100:00100000:1.0:1790946622.129074:0:14478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303364608 00000100:00100000:1.0:1790946622.129123:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790946622.129131:0:14478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b583f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+11:14468:x1877943303364608:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790946622.129357:0:14478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b583f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+11:14468:x1877943303364608:12345-0@lo:503:mount.lustre.0 Request processed in 226us (1280us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946622.129365:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790946622.129503:0:14468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be98ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14468:1877943303364608:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790946622.129924:0:14512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91468e93d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14512:1877943303364736:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790946622.129971:0:14512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946622.130008:0:14512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146b602cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1790946622.130048:0:14481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303364736 00000100:00100000:0.0:1790946622.130054:0:14481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303364736 00000100:00100000:0.0:1790946622.130088:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790946622.130096:0:14481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b583d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+11:14512:x1877943303364736:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790946622.130337:0:14481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b583d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+11:14512:x1877943303364736:12345-0@lo:502:llog_process_th.0 Request processed in 241us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946622.130344:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790946622.130511:0:14512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91468e93d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14512:1877943303364736:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790946622.130537:0:14512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790946622.130547:0:14512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946622.130549:0:14512:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1790946622.130556:0:14512:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff914586f39800 00000020:00000080:2.0:1790946622.130559:0:14512:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790946622.130567:0:14512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790946622.130569:0:14512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946622.130570:0:14512:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1790946622.130572:0:14512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790946622.130575:0:14512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946622.130576:0:14512:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1790946622.130581:0:14512:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff914586f39800 00000020:00000080:2.0:1790946622.130583:0:14512:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790946622.130651:0:14512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790946622.130654:0:14512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946622.130656:0:14512:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1790946622.130658:0:14512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790946622.130661:0:14512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946622.130662:0:14512:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1790946622.130665:0:14512:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff914586f39800 00000020:00000080:2.0:1790946622.130666:0:14512:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1790946622.130700:0:14512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5a68e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14512:1877943303364864:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790946622.130738:0:14512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946622.130774:0:14512:0:(client.c:2716:ptlrpc_set_wait()) set ffff914683162d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790946622.132746:0:14480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303364864 00000100:00100000:0.0:1790946622.132759:0:14480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303364864 00000100:00100000:0.0:1790946622.132805:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790946622.132813:0:14480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b583dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+11:14512:x1877943303364864:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790946622.133057:0:14480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b583dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+11:14512:x1877943303364864:12345-0@lo:502:llog_process_th.0 Request processed in 245us (2318us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946622.133065:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790946622.133149:0:14512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5a68e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14512:1877943303364864:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790946622.133185:0:14512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790946622.133192:0:14512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790946622.133194:0:14512:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1790946622.133216:0:14512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1790946622.133625:0:14468:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1790946622.133646:0:14468:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790946622.133666:0:14468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146b1932a00/0x16e41aef93272d3e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93272d45 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946622.133677:0:14468:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9146b1932a00/0x16e41aef93272d3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93272d45 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790946622.133722:0:14468:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1790946622.133725:0:14468:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff914586f39800 10000000:01000000:2.0:1790946622.133728:0:14468:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff914586f39800 10000000:01000000:2.0:1790946622.133731:0:14468:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790946622.133737:0:14468:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff914586f39800 from 1 10000000:01000000:2.0:1790946622.133739:0:14468:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790946622.133770:0:14468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff914688aee400/0x16e41aef93272d4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946622.133779:0:14468:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff914688aee400/0x16e41aef93272d4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946622.133788:0:14468:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff914688aee400/0x16e41aef93272d4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946622.133805:0:14468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5a6a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14468:1877943303364992:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790946622.133844:0:14468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946622.133876:0:14468:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146b602cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1790946622.142974:0:14478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303364992 00000100:00100000:1.0:1790946622.142990:0:14478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303364992 00000100:00100000:1.0:1790946622.157776:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790946622.157797:0:14478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b583ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+11:14468:x1877943303364992:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790946622.157817:0:14478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946622.157837:0:14478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9146b180f600/0x16e41aef93272d53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x16e41aef93272d4c expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946622.157867:0:14478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9146b180f600/0x16e41aef93272d53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x16e41aef93272d4c expref: 12 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946622.157878:0:14478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9146b180f600/0x16e41aef93272d53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93272d4c expref: 12 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946622.157886:0:14478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b180f600, rc 0) 00000100:00100000:1.0:1790946622.157969:0:14478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b583ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+12:14468:x1877943303364992:12345-0@lo:101:mount.lustre.0 Request processed in 180us (24124us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946622.157977:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790946622.158766:0:14468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5a6a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14468:1877943303364992:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790946622.158788:0:14468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff914688aee400/0x16e41aef93272d4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93272d53 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946622.158812:0:14468:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff914688aee400/0x16e41aef93272d4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93272d53 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946622.158881:0:14468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5a6a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14468:1877943303365120:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790946622.158919:0:14468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946622.158988:0:14468:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146b602cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1790946622.160558:0:14481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303365120 00000100:00100000:0.0:1790946622.160571:0:14481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303365120 00000100:00100000:3.0:1790946622.167693:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790946622.167710:0:14481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b583f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+12:14468:x1877943303365120:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790946622.168015:0:14481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b583f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+12:14468:x1877943303365120:12345-0@lo:501:mount.lustre.0 Request processed in 309us (9094us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946622.168024:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790946622.168108:0:14468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5a6a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14468:1877943303365120:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790946622.168169:0:14468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5a6a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14468:1877943303365248:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790946622.168246:0:14468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946622.168622:0:14468:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146b602cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1790946622.169053:0:14478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303365248 00000100:00100000:1.0:1790946622.169062:0:14478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303365248 00000100:00100000:1.0:1790946622.169096:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1790946622.169104:0:14478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b583c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+12:14468:x1877943303365248:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790946622.169329:0:14478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b583c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+12:14468:x1877943303365248:12345-0@lo:503:mount.lustre.0 Request processed in 225us (1083us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946622.169337:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790946622.169509:0:14468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5a6a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14468:1877943303365248:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790946622.169895:0:14518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5a6a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14518:1877943303365376:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790946622.169937:0:14518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946622.169973:0:14518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146901ebe40 going to sleep for 11 seconds 00000100:00100000:1.0:1790946622.170014:0:14478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303365376 00000100:00100000:1.0:1790946622.170019:0:14478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303365376 00000100:00100000:1.0:1790946622.170052:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790946622.170059:0:14478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b583c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+12:14518:x1877943303365376:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790946622.170286:0:14478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b583c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+12:14518:x1877943303365376:12345-0@lo:502:llog_process_th.0 Request processed in 228us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946622.170293:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790946622.170782:0:14518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5a6a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14518:1877943303365376:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1790946622.170842:0:14518:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1790946622.170857:0:14518:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff91468e3e4d40) 00000020:00000080:2.0:1790946622.170875:0:14518:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1790946622.170952:0:14518:0:(tgt_mount.c:153:server_get_mount()) get mount ffff914586f39800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1790946622.170956:0:14518:0:(tgt_mount.c:187:server_put_mount()) put mount ffff914586f39800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1790946622.170958:0:14518:0:(obd_mount.c:710:lustre_put_lsi()) put ffff914586f39800 4 00010000:00080000:2.0:1790946622.170988:0:14518:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9146aa74e000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.113@tcp at head 00010000:00010000:2.0:1790946622.173079:0:14518:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1790946622.173311:0:14518:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1790946622.173356:0:14518:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790946622.173367:0:14518:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x16e41aef93272d61 00000100:00080000:2.0:1790946622.173376:0:14518:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790946622.173386:0:14518:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9146aa74e000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:2.0:1790946622.173430:0:14518:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9146b5a6a300 x1877943303365504/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790946622.173457:0:14518:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1790946622.173549:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5a6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1877943303365504:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1790946622.173629:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946622.175726:0:14486:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303365504 00000100:00100000:2.0:1790946622.175739:0:14486:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303365504 00000100:00100000:2.0:1790946622.175777:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790946622.175785:0:14486:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be98fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1877943303365504:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790946622.175863:0:14486:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be98fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1877943303365504:12345-0@lo:38:llog_process_th.0 Request processed in 78us (2234us total) trans 0 rc -11/-11 00000100:00100000:2.0:1790946622.175869:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790946622.175980:0:14518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5a6bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14518:1877943303365632:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790946622.176022:0:14518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946622.176049:0:14518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146901eb0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790946622.176107:0:14478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303365632 00000100:00100000:2.0:1790946622.176111:0:14478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303365632 00000100:00100000:2.0:1790946622.176134:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790946622.176189:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790946622.176197:0:3299:0:(import.c:65:import_set_state_nolock()) ffff9146aa74e000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790946622.176221:0:3299:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1790946622.176225:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5a6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1877943303365504:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790946622.177785:0:14478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b583e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+12:14518:x1877943303365632:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790946622.178083:0:14478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b583e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+12:14518:x1877943303365632:12345-0@lo:502:llog_process_th.0 Request processed in 1942us (2060us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946622.178092:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790946622.181146:0:14518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5a6bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14518:1877943303365632:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1790946622.181192:0:14518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1790946622.181905:0:14468:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1790946622.181932:0:14468:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790946622.181981:0:14468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff914688aee400/0x16e41aef93272d4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93272d53 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946622.182003:0:14468:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff914688aee400/0x16e41aef93272d4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93272d53 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1790946622.182046:0:14468:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1790946622.182048:0:14468:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790946622.182050:0:14468:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790946622.182051:0:14468:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790946622.182052:0:14468:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790946622.182054:0:14468:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790946622.182056:0:14468:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790946622.182057:0:14468:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790946622.182059:0:14468:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790946622.182060:0:14468:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790946622.182064:0:14468:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1790946622.182066:0:14468:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790946622.182067:0:14468:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790946622.182069:0:14468:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790946622.182070:0:14468:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790946622.182071:0:14468:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790946622.182072:0:14468:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790946622.182073:0:14468:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790946622.182074:0:14468:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790946622.182075:0:14468:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790946622.182076:0:14468:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790946622.182098:0:14468:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1790946622.182114:0:14468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5a69880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14468:1877943303365760:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790946622.182187:0:14468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946622.182341:0:14468:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146901eb3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790946622.182530:0:14481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303365760 00000100:00100000:0.0:1790946622.182538:0:14481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303365760 00000100:00100000:0.0:1790946622.182618:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790946622.182629:0:14481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b583cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+12:14468:x1877943303365760:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790946622.182656:0:14481:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1790946622.182668:0:14481:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1790946622.228945:0:14481:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1790946622.228975:0:14481:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1790946622.229006:0:14502:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1790946622.229010:0:14502:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1790946622.229032:0:14502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9146b1933000/0x16e41aef93272d68 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946622.229051:0:14502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9146b180ee00/0x16e41aef93272d37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93272d30 expref: 12 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946622.229060:0:14502:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9146b1933000/0x16e41aef93272d68 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946622.229096:0:14502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9146b180ee00/0x16e41aef93272d37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x16e41aef93272d30 expref: 12 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946622.229109:0:14502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9146b180ee00/0x16e41aef93272d37 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x16e41aef93272d30 expref: 12 pid: 14480 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946622.229123:0:14502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be98d880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14502:1877943303365888:0@lo:104: 00000100:00100000:0.0:1790946622.229221:0:14502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946622.229258:0:14502:0:(client.c:2716:ptlrpc_set_wait()) set ffff914586872c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790946622.229308:0:14469:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303365888 00000100:00100000:0.0:1790946622.229316:0:14469:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303365888 00000100:00100000:0.0:1790946622.229354:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790946622.229362:0:14469:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be98ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+3:14502:x1877943303365888:12345-0@lo:104: 00010000:00010000:0.0:1790946622.229375:0:14469:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9146b1933400/0x16e41aef93272d30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93272d37 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946622.229422:0:14469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790946622.229427:0:14469:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be98ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+3:14502:x1877943303365888:12345-0@lo:104: Request processed in 66us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946622.229443:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1790946622.229467:0:14475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790946622.229474:0:14475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9146b1933400/0x16e41aef93272d30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93272d37 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946622.229481:0:14475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1933400 already unused, calling callback (ffffffffc1d96c20) 10000000:00010000:0.0:1790946622.229485:0:14475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9146b1933400/0x16e41aef93272d30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x16e41aef93272d37 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946622.229494:0:14475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9146b1933400/0x16e41aef93272d30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x16e41aef93272d37 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790946622.229503:0:14475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9146b1933400/0x16e41aef93272d30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x16e41aef93272d37 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790946622.229509:0:14475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790946622.229532:0:14475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9146b1933400/0x16e41aef93272d30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93272d37 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946622.229538:0:14475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790946622.229556:0:14475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9146b1933400/0x16e41aef93272d30 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93272d37 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946622.229563:0:14475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9146b1933400/0x16e41aef93272d30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93272d37 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946622.229579:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946622.229581:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946622.229583:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946622.229615:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be98dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:3303:1877943303366016:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790946622.229649:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946622.229712:0:14471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303366016 00000100:00100000:0.0:1790946622.229717:0:14471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303366016 00010000:00010000:0.0:1790946622.229733:0:14471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9146b180ee00/0x16e41aef93272d37 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef93272d30 expref: 13 pid: 14480 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946622.229755:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790946622.229762:0:14471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be98c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+13:3303:x1877943303366016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790946622.229781:0:14471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790946622.229787:0:14471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9146b180ee00/0x16e41aef93272d37 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef93272d30 expref: 13 pid: 14480 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946622.229797:0:14471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9146b180ee00/0x16e41aef93272d37 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x16e41aef93272d30 expref: 13 pid: 14480 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946622.229811:0:14471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9146b1933000/0x16e41aef93272d68 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946622.229817:0:14471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9146b1933000/0x16e41aef93272d68 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790946622.229828:0:14471:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000818876s 00010000:00010000:0.0:1790946622.229833:0:14471:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9146b1933000/0x16e41aef93272d68 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946622.229840:0:14471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9146b1933000/0x16e41aef93272d68 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946622.229846:0:14471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9146b1933000/0x16e41aef93272d68 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946622.229862:0:14471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9146b1933000/0x16e41aef93272d68 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946622.229868:0:14471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1933000 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:0.0:1790946622.229871:0:14471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9146b1933000/0x16e41aef93272d68 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946622.229878:0:14471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9146b1933000/0x16e41aef93272d68 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946622.229887:0:14471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9146b1933000/0x16e41aef93272d68 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946622.229897:0:14471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790946622.229928:0:14471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be98c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+13:3303:x1877943303366016:12345-0@lo:103:ldlm_bl.0 Request processed in 166us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946622.229935:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790946622.229973:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be98dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:3303:1877943303366016:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790946622.229997:0:14502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9146b180ee00/0x16e41aef93272d37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x16e41aef93272d30 expref: 12 pid: 14480 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946622.230007:0:14502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be98d880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14502:1877943303365888:0@lo:104: 00010000:00010000:0.0:1790946622.230017:0:14502:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9146b1933000/0x16e41aef93272d68 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946622.230026:0:14502:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9146b1933000/0x16e41aef93272d68 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946622.230043:0:14502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9146b1933000/0x16e41aef93272d68 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946622.230049:0:14502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9146b1933000/0x16e41aef93272d68 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946622.238099:0:14481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b583cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+11:14468:x1877943303365760:12345-0@lo:253:mount.lustre.0 Request processed in 55464us (55903us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946622.238114:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790946622.238367:0:14468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5a69880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14468:1877943303365760:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790946622.238382:0:14468:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1790946622.238386:0:14468:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790946622.238388:0:14468:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790946622.238389:0:14468:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790946622.238405:0:14468:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790946622.238407:0:14468:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790946622.238408:0:14468:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790946622.238410:0:14468:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790946622.238411:0:14468:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790946622.238413:0:14468:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790946622.238414:0:14468:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1790946622.238430:0:14468:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1790946622.243505:0:14468:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1790946622.243753:0:14468:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1790946622.244103:0:14468:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1790946622.244286:0:14468:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1790946622.244517:0:14468:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1790946622.245026:0:14468:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1790946622.247765:0:14468:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1790946622.248070:0:14468:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1790946622.248391:0:14468:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1790946622.248679:0:14468:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1790946622.249068:0:14468:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1790946622.249330:0:14468:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1790946622.285015:0:14468:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1790946622.285434:0:14468:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1790946622.285819:0:14525:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1790946622.285886:0:14525:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1790946622.288573:0:14468:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000020:00080000:0.0:1790946622.289755:0:14524:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1790946622.289762:0:14524:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:1.0:1790946622.290072:0:14468:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1790946622.290520:0:14468:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1790946622.290532:0:14468:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1790946622.291556:0:14525:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1790946622.291896:0:14525:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1790946622.291901:0:14525:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:1.0:1790946622.292062:0:14468:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790946622.293533:0:14468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1790946622.294058:0:14468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1790946622.294097:0:14468:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1790946622.295438:0:14468:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1790946622.301508:0:14468:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1790946622.326307:0:14468:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1790946622.326342:0:14468:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa164c1cb7988 00100000:10000000:2.0:1790946622.326351:0:14468:0:(lfsck_lib.c:3084:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1790946622.327587:0:14468:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1790946622.327720:0:14468:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.113@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1790946622.327738:0:14468:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1790946622.327761:0:14468:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1790946622.642941:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1790946623.152284:0:14483:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1790946623.152291:0:14483:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff914586f39800 from 6 10000000:01000000:3.0:1790946623.152296:0:14483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790946623.152377:0:14483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146be9f7e00/0x16e41aef93272d6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946623.152389:0:14483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9146be9f7e00/0x16e41aef93272d6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946623.152400:0:14483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9146be9f7e00/0x16e41aef93272d6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946623.152432:0:14483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914698016a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14483:1877943303366144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790946623.152496:0:14483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946623.152538:0:14483:0:(client.c:2716:ptlrpc_set_wait()) set ffff91468485c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790946623.152682:0:14480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303366144 00000100:00100000:0.0:1790946623.152690:0:14480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303366144 00000100:00100000:0.0:1790946623.152739:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790946623.152748:0:14480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b583e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+11:14483:x1877943303366144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790946623.152763:0:14480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946623.152776:0:14480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9146b1933400/0x16e41aef93272d76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x16e41aef93272d6f expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946623.152800:0:14480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9146b1933400/0x16e41aef93272d76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x16e41aef93272d6f expref: 12 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946623.152810:0:14480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9146b1933400/0x16e41aef93272d76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93272d6f expref: 12 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946623.152818:0:14480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b1933400, rc 0) 00000100:00100000:0.0:1790946623.152929:0:14480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b583e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+12:14483:x1877943303366144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 181us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946623.152936:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790946623.158368:0:14483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914698016a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14483:1877943303366144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790946623.158394:0:14483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9146be9f7e00/0x16e41aef93272d6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93272d76 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946623.158406:0:14483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9146be9f7e00/0x16e41aef93272d6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93272d76 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946623.158528:0:14483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5a69880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14483:1877943303366272:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1790946623.158592:0:14483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946623.158638:0:14483:0:(client.c:2716:ptlrpc_set_wait()) set ffff91468eb6ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1790946623.158755:0:14481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303366272 00000100:00100000:3.0:1790946623.158762:0:14481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303366272 00000100:00100000:3.0:1790946623.158811:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790946623.158820:0:14481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b583d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+12:14483:x1877943303366272:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1790946623.158841:0:14481:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1790946623.158857:0:14481:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1790946623.158861:0:14481:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1790946623.158953:0:14481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b583d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+12:14483:x1877943303366272:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 132us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946623.158961:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790946623.159057:0:14483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5a69880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14483:1877943303366272:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1790946623.159106:0:14483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790946623.159115:0:14483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146be9f7e00/0x16e41aef93272d6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93272d76 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946623.159124:0:14483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9146be9f7e00/0x16e41aef93272d6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93272d76 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790946623.223761:0:14517:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790946623.665402:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790946624.246233:0:14517:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1790946624.688324:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946625.712732:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946626.737327:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790946627.570194:0:14039:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790946627.570224:0:14039:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790946627.570227:0:14039:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790946627.570229:0:14039:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790946627.570232:0:14039:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1790946627.570434:0:14039:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:3.0:1790946627.570437:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5a6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:3300:1877943303366400:0@lo:400:kworker.0 00000100:00080000:2.0:1790946627.570438:0:14039:0:(import.c:65:import_set_state_nolock()) ffff9146aa74e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790946627.570451:0:14039:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9146aa74e000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:2.0:1790946627.570474:0:14039:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9146b5a69c00 x1877943303366528/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790946627.570517:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946627.570756:0:14480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303366400 00000100:00100000:2.0:1790946627.570764:0:14480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303366400 00000100:00100000:2.0:1790946627.570810:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790946627.570818:0:14480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b583e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+12:3300:x1877943303366400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946627.570873:0:14480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b583e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+12:3300:x1877943303366400:12345-0@lo:400:kworker.0 Request processed in 55us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946627.570880:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790946627.570962:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5a6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:3300:1877943303366400:0@lo:400:kworker.0 00000100:00100000:1.0:1790946627.571339:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5a69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1877943303366528:0@lo:38:kworker.0 00000100:00100000:1.0:1790946627.571378:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946627.571561:0:14488:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303366528 00000100:00100000:3.0:1790946627.571567:0:14488:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303366528 00000100:00100000:3.0:1790946627.571601:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790946627.571607:0:14488:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468e93ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3299:x1877943303366528:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1790946627.571629:0:14488:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 412 last 0 00000020:00000080:3.0:1790946627.571660:0:14488:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x16e41aef93272d7d 00000004:00100000:3.0:1790946627.571674:0:14488:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1790946627.571905:0:14488:0:(import.c:65:import_set_state_nolock()) ffff914684d89000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790946627.571962:0:14488:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468e93ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1877943303366528:12345-0@lo:38:kworker.0 Request processed in 353us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946627.571968:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1790946627.573374:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9146b5a69c00 x1877943303366528/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790946637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1790946627.573394:0:3299:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1790946627.573402:0:3299:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1790946627.573407:0:3299:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1790946627.573409:0:3299:0:(import.c:65:import_set_state_nolock()) ffff9146aa74e000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790946627.573422:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5a69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1877943303366528:0@lo:38:kworker.0 00010000:00010000:0.0:1790946627.762615:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790946628.087120:0:14768:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1790946628.787283:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946629.808604:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946630.832342:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1790946631.182416:0:14918:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffa2bfb970 20000000:00000080:1.0:1790946631.182433:0:14918:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9146beb0d400 uarg=0000000000000000 20000000:01000000:1.0:1790946631.182464:0:14918:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1790946631.182471:0:14918:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1790946631.182475:0:14918:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1790946631.183566:0:14919:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1790946631.183733:0:14918:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1790946631.191456:0:14918:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1790946631.191486:0:14918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9146be9f6800/0x16e41aef93272d84 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946631.191505:0:14918:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9146b180f000/0x16e41aef93272d45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93272d3e expref: 11 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946631.191515:0:14918:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9146be9f6800/0x16e41aef93272d84 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946631.191559:0:14918:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9146b180f000/0x16e41aef93272d45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x16e41aef93272d3e expref: 11 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946631.191573:0:14918:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9146b180f000/0x16e41aef93272d45 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x16e41aef93272d3e expref: 11 pid: 14481 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946631.191682:0:14918:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914698016a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14918:1877943303366656:0@lo:104: 00000100:00100000:3.0:1790946631.191810:0:14918:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946631.191863:0:14918:0:(client.c:2716:ptlrpc_set_wait()) set ffff914586872f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790946631.191942:0:14470:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303366656 00000100:00100000:0.0:1790946631.191950:0:14470:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303366656 00000100:00100000:0.0:1790946631.191999:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790946631.192008:0:14470:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914698015c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+3:14918:x1877943303366656:12345-0@lo:104: 00010000:00010000:0.0:1790946631.192020:0:14470:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9146b1932a00/0x16e41aef93272d3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93272d45 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946631.192247:0:14470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790946631.192254:0:14470:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914698015c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+3:14918:x1877943303366656:12345-0@lo:104: Request processed in 248us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946631.192262:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790946631.192373:0:14918:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914698016a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14918:1877943303366656:0@lo:104: 00010000:00010000:3.0:1790946631.192391:0:14918:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9146be9f6800/0x16e41aef93272d84 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946631.192818:0:14475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790946631.192826:0:14475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9146b1932a00/0x16e41aef93272d3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93272d45 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946631.192833:0:14475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1932a00 already unused, calling callback (ffffffffc1d96c20) 10000000:00010000:1.0:1790946631.192837:0:14475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9146b1932a00/0x16e41aef93272d3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x16e41aef93272d45 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946631.192845:0:14475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9146b1932a00/0x16e41aef93272d3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x16e41aef93272d45 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790946631.192852:0:14475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9146b1932a00/0x16e41aef93272d3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x16e41aef93272d45 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790946631.192857:0:14475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790946631.192894:0:14475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9146b1932a00/0x16e41aef93272d3e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93272d45 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946631.192901:0:14475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790946631.192921:0:14475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9146b1932a00/0x16e41aef93272d3e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93272d45 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946631.192940:0:14475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9146b1932a00/0x16e41aef93272d3e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93272d45 expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946631.192957:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946631.192959:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946631.192961:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946631.192973:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91468e93ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:3301:1877943303366784:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790946631.193007:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946631.193268:0:14471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303366784 00000100:00100000:0.0:1790946631.193275:0:14471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303366784 00010000:00010000:0.0:1790946631.193295:0:14471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9146b180f000/0x16e41aef93272d45 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef93272d3e expref: 12 pid: 14481 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946631.193318:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790946631.193333:0:14471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468e93e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+12:3301:x1877943303366784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790946631.193344:0:14471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790946631.193349:0:14471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9146b180f000/0x16e41aef93272d45 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef93272d3e expref: 12 pid: 14481 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946631.193359:0:14471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9146b180f000/0x16e41aef93272d45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x16e41aef93272d3e expref: 12 pid: 14481 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946631.193371:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9146b180f000/0x16e41aef93272d45 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x16e41aef93272d3e expref: 12 pid: 14481 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946631.193383:0:14471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9146be9f6800/0x16e41aef93272d84 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946631.193390:0:14471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9146be9f6800/0x16e41aef93272d84 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946631.193401:0:14471:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9146be9f6800/0x16e41aef93272d84 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946631.193408:0:14471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9146be9f6800/0x16e41aef93272d84 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946631.193414:0:14471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9146be9f6800/0x16e41aef93272d84 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946631.193420:0:14471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9146be9f6800/0x16e41aef93272d84 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946631.193426:0:14471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146be9f6800 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:0.0:1790946631.193430:0:14471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9146be9f6800/0x16e41aef93272d84 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946631.193444:0:14471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9146be9f6800/0x16e41aef93272d84 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946631.193458:0:14471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9146be9f6800/0x16e41aef93272d84 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946631.193466:0:14471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790946631.193501:0:14471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468e93e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+11:3301:x1877943303366784:12345-0@lo:103:ldlm_bl.0 Request processed in 168us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946631.193508:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790946631.193540:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91468e93ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:3301:1877943303366784:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790946631.194827:0:14918:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9146be9f6800/0x16e41aef93272d84 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946631.194841:0:14918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9146be9f6800/0x16e41aef93272d84 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946631.194859:0:14918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9146be9f6800/0x16e41aef93272d84 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946631.864685:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1790946632.500957:0:14483:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790946632.500965:0:14483:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff914586f39800 from 10 10000000:01000000:2.0:1790946632.500969:0:14483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790946632.501011:0:14483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff914688aef200/0x16e41aef93272d8b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946632.501024:0:14483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff914688aef200/0x16e41aef93272d8b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946632.501035:0:14483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff914688aef200/0x16e41aef93272d8b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946632.501059:0:14483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5a68700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14483:1877943303366912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790946632.501138:0:14483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946632.501188:0:14483:0:(client.c:2716:ptlrpc_set_wait()) set ffff91468298fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1790946632.501508:0:14478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303366912 00000100:00100000:1.0:1790946632.501517:0:14478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303366912 00000100:00100000:1.0:1790946632.501568:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790946632.501577:0:14478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b79acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+11:14483:x1877943303366912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790946632.501589:0:14478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946632.501603:0:14478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9146b180ee00/0x16e41aef93272d92 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x16e41aef93272d8b expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946632.501627:0:14478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9146b180ee00/0x16e41aef93272d92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x16e41aef93272d8b expref: 12 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946632.501637:0:14478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9146b180ee00/0x16e41aef93272d92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93272d8b expref: 12 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946632.501645:0:14478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b180ee00, rc 0) 00000100:00100000:1.0:1790946632.501688:0:14478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b79acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+12:14483:x1877943303366912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946632.501695:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790946632.502046:0:14483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5a68700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14483:1877943303366912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790946632.502084:0:14483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff914688aef200/0x16e41aef93272d8b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93272d92 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946632.502094:0:14483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff914688aef200/0x16e41aef93272d8b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93272d92 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946632.502146:0:14483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91468e93d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14483:1877943303367040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790946632.502174:0:14483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946632.502230:0:14483:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146be9aa000 going to sleep for 11 seconds 00000100:00100000:1.0:1790946632.502244:0:14481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303367040 00000100:00100000:1.0:1790946632.502248:0:14481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303367040 00000100:00100000:1.0:1790946632.502405:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790946632.502413:0:14481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b79adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+12:14483:x1877943303367040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790946632.502640:0:14481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b79adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+12:14483:x1877943303367040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 228us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946632.502647:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790946632.502683:0:14483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91468e93d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14483:1877943303367040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790946632.502710:0:14483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91468e93d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14483:1877943303367168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790946632.504144:0:14483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946632.504183:0:14483:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146be9aa000 going to sleep for 11 seconds 00000100:00100000:0.0:1790946632.504531:0:14481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303367168 00000100:00100000:0.0:1790946632.504541:0:14481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303367168 00000100:00100000:0.0:1790946632.504576:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790946632.504583:0:14481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b79ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+12:14483:x1877943303367168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790946632.504769:0:14481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b79ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+12:14483:x1877943303367168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 186us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946632.504776:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790946632.504911:0:14483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91468e93d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14483:1877943303367168:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1790946632.505906:0:14955:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1790946632.506122:0:14483:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1790946632.506141:0:14483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790946632.506152:0:14483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff914688aef200/0x16e41aef93272d8b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93272d92 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946632.506162:0:14483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff914688aef200/0x16e41aef93272d8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93272d92 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1790946632.688384:0:14039:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790946632.688397:0:14039:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790946632.688400:0:14039:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790946632.688404:0:14039:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1790946632.689245:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91468e93ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877943303367296:0@lo:400:kworker.0 00000100:00100000:0.0:1790946632.689327:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946632.689657:0:14487:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303367296 00000100:00100000:1.0:1790946632.689666:0:14487:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303367296 00000100:00100000:1.0:1790946632.689704:0:14487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790946632.689712:0:14487:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be98d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877943303367296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946632.689765:0:14487:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be98d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877943303367296:12345-0@lo:400:kworker.0 Request processed in 54us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946632.689771:0:14487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1790946632.689946:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91468e93ce00 x1877943303367296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946648 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946632.689959:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91468e93ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877943303367296:0@lo:400:kworker.0 00000100:00100000:0.0:1790946632.691542:0:3299:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790946622/real 1790946622] req@ffff9146b5a6ad80 x1877943303363840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790946632 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946632.691578:0:3299:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9146b5a6ad80 x1877943303363840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790946632 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946632.697001:0:3299:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790946622/real 1790946622] req@ffff9146b5a6a680 x1877943303363712/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790946632 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946632.697028:0:3299:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9146b5a6a680 x1877943303363712/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790946632 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790946632.697047:0:3299:0:(import.c:65:import_set_state_nolock()) ffff9146851e9000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790946632.697085:0:3299:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790946632.697089:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5a6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1877943303363840:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1790946632.697096:0:3299:0:(import.c:65:import_set_state_nolock()) ffff9146b581e800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790946632.697100:0:3299:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790946632.697103:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5a6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1877943303363712:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1790946632.702230:0:14039:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790946632.702238:0:14039:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1790946632.702241:0:14039:0:(import.c:65:import_set_state_nolock()) ffff9146b581e800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790946632.702249:0:14039:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 407 00000100:00080000:3.0:1790946632.702254:0:14039:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1790946632.702266:0:14039:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9146b581e800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:3.0:1790946632.702309:0:14039:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff914698016a00 x1877943303367424/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790946632.702332:0:14039:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790946632.702335:0:14039:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1790946632.702337:0:14039:0:(import.c:65:import_set_state_nolock()) ffff9146851e9000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790946632.702339:0:14039:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 407 00000100:00080000:3.0:1790946632.702342:0:14039:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1790946632.702347:0:14039:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9146851e9000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:3.0:1790946632.702358:0:14039:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff914698016300 x1877943303367552/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790946632.702455:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914698016a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1877943303367424:0@lo:8:kworker.0 00000400:00000100:3.0:1790946632.702518:0:3299:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877943303367424 offset 0 length 520: 4 00000100:00100000:3.0:1790946632.702561:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914698016300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1877943303367552:0@lo:8:kworker.0 00000400:00000100:3.0:1790946632.702580:0:3299:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877943303367552 offset 0 length 520: 4 00010000:00010000:1.0:1790946632.881243:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946633.905019:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790946634.490258:0:14517:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790946634.932034:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946635.953381:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1790946636.879393:0:15167:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1790946636.879399:0:15167:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1790946636.880336:0:15167:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9146b7977800 00000020:01000004:0.0:1790946636.880361:0:15167:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1790946636.880376:0:15167:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1790946636.880396:0:15167:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9146849db380) 00000020:00000080:0.0:1790946636.880416:0:15167:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1790946636.922099:0:15167:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1790946636.924382:0:15167:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1790946636.927126:0:15167:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1790946636.927498:0:15167:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1790946636.927889:0:15167:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1790946636.928320:0:15167:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 461: rc = 0 00100000:10000000:3.0:1790946636.928475:0:15167:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 461: rc = 0 00100000:10000000:3.0:1790946636.928575:0:15167:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 461: rc = 0 00100000:10000000:3.0:1790946636.929331:0:15167:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 71: rc = 0 00100000:10000000:3.0:1790946636.929609:0:15167:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 71: rc = 0 00100000:10000000:3.0:1790946636.930445:0:15167:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 71: rc = 0 00100000:10000000:3.0:1790946636.930736:0:15167:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 71: rc = 0 00100000:10000000:3.0:1790946636.935927:0:15167:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 71: rc = 0 00100000:10000000:3.0:1790946636.939006:0:15167:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 71: rc = 0 00000020:00000080:3.0:1790946636.939666:0:15167:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1790946636.939676:0:15167:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1790946636.939686:0:15167:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x16e41aef93272da0 00000020:01000004:3.0:1790946636.939694:0:15167:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1790946636.939714:0:15167:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.113@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1790946636.939718:0:15167:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.113@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1790946636.939724:0:15167:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1790946636.939728:0:15167:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1790946636.939740:0:15167:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff91469e0b8000) 00000020:00000080:3.0:1790946636.939756:0:15167:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1790946636.940952:0:15167:0:(service.c:173:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790946636.941136:0:15167:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1790946636.941142:0:15167:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1790946636.948543:0:15167:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1790946636.948561:0:15167:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1790946636.952932:0:15167:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1790946636.952947:0:15167:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1790946636.955849:0:15167:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790946636.956053:0:15167:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1790946636.956060:0:15167:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1790946636.958715:0:15167:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1790946636.958729:0:15167:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00010000:00010000:1.0:1790946636.976449:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946636.989955:0:15167:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790946636.993912:0:15167:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1790946636.993922:0:15167:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1790946636.995180:0:15167:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1790946636.995190:0:15167:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1790946636.995982:0:15167:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1790946636.995990:0:15167:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1790946637.013569:0:15167:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790946637.013763:0:15167:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1790946637.013769:0:15167:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1790946637.018252:0:15167:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1790946637.018264:0:15167:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1790946637.086135:0:15167:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790946637.089077:0:15167:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1790946637.089086:0:15167:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1790946637.095981:0:15167:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1790946637.095999:0:15167:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1790946637.096996:0:15167:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1790946637.097024:0:15167:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1790946637.097038:0:15167:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.113@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1790946637.109689:0:15167:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.113@tcp ctxt 0 is initialized 00000020:01000004:1.0:1790946637.109735:0:15167:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.113@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1790946637.109740:0:15167:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1790946637.109741:0:15167:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790946637.109743:0:15167:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790946637.109744:0:15167:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790946637.109745:0:15167:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790946637.109746:0:15167:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790946637.109748:0:15167:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790946637.109749:0:15167:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790946637.109751:0:15167:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790946637.109755:0:15167:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1790946637.109756:0:15167:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790946637.109757:0:15167:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790946637.109758:0:15167:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790946637.109759:0:15167:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790946637.109760:0:15167:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790946637.109761:0:15167:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790946637.109762:0:15167:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790946637.109763:0:15167:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790946637.109764:0:15167:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790946637.109790:0:15167:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1790946637.109817:0:15167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91468e93fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15167:1877943303367680:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1790946637.109893:0:15167:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946637.110012:0:15167:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146848559c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790946637.110111:0:14480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303367680 00000100:00100000:2.0:1790946637.110119:0:14480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303367680 00000100:00100000:2.0:1790946637.110241:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790946637.110250:0:14480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146987c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+12:15167:x1877943303367680:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1790946637.110292:0:14480:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1790946637.110296:0:14480:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1790946637.110300:0:14480:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1790946637.124596:0:14480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146987c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+12:15167:x1877943303367680:12345-0@lo:253:mount.lustre.0 Request processed in 14338us (14693us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946637.124610:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790946637.124794:0:15167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91468e93fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15167:1877943303367680:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1790946637.124809:0:15167:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1790946637.124812:0:15167:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790946637.124813:0:15167:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790946637.124815:0:15167:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790946637.124816:0:15167:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790946637.124817:0:15167:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790946637.124818:0:15167:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790946637.124819:0:15167:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790946637.124821:0:15167:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790946637.124823:0:15167:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1790946637.124841:0:15167:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9146b7977800 from lustre-OST0000 10000000:01000000:1.0:1790946637.124865:0:15167:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1790946637.124867:0:15167:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1790946637.124874:0:15167:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9146849dcd40 local copy 00010000:00010000:1.0:1790946637.124884:0:15167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff914688aef000/0x16e41aef93272c96 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93272c9d expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946637.125128:0:15167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91468e93fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15167:1877943303367808:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790946637.125164:0:15167:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946637.125404:0:15167:0:(client.c:2716:ptlrpc_set_wait()) set ffff914684855cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790946637.125469:0:14478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303367808 00000100:00100000:2.0:1790946637.125475:0:14478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303367808 00000100:00100000:2.0:1790946637.125520:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790946637.125528:0:14478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beda0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+12:15167:x1877943303367808:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790946637.125688:0:14478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beda0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+12:15167:x1877943303367808:12345-0@lo:501:mount.lustre.0 Request processed in 160us (522us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790946637.125703:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790946637.125870:0:15167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91468e93fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15167:1877943303367808:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1790946637.125886:0:15167:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.113@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1790946637.126049:0:15167:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.113@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1790946637.126056:0:15167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff914688aef000/0x16e41aef93272c96 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93272c9d expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946637.126066:0:15167:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff914688aef000/0x16e41aef93272c96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93272c9d expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790946637.126096:0:15167:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9146b7977800 10000000:01000000:3.0:1790946637.126100:0:15167:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1790946637.126105:0:15167:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9146849dcd40 10000000:01000000:3.0:1790946637.126107:0:15167:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1790946637.126110:0:15167:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9146849dcd40 from 1 10000000:01000000:3.0:1790946637.126127:0:15167:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1790946637.126151:0:15167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146be9f7200/0x16e41aef93272dae lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946637.126159:0:15167:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9146be9f7200/0x16e41aef93272dae lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946637.126167:0:15167:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9146be9f7200/0x16e41aef93272dae lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946637.126181:0:15167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914698015500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15167:1877943303367936:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790946637.126241:0:15167:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946637.126258:0:15167:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146becd7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790946637.126359:0:14478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303367936 00000100:00100000:2.0:1790946637.126364:0:14478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303367936 00000100:00100000:2.0:1790946637.126395:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790946637.126401:0:14478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beda0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+12:15167:x1877943303367936:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790946637.126412:0:14478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946637.126424:0:14478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff914688aefa00/0x16e41aef93272db5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x16e41aef93272dae expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946637.126445:0:14478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff914688aefa00/0x16e41aef93272db5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x16e41aef93272dae expref: 13 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946637.126466:0:14478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff914688aefa00/0x16e41aef93272db5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93272dae expref: 13 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946637.126473:0:14478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914688aefa00, rc 0) 00000100:00100000:2.0:1790946637.126508:0:14478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beda0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+13:15167:x1877943303367936:12345-0@lo:101:mount.lustre.0 Request processed in 107us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946637.126515:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790946637.126629:0:15167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914698015500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15167:1877943303367936:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790946637.126640:0:15167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9146be9f7200/0x16e41aef93272dae lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93272db5 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946637.126649:0:15167:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9146be9f7200/0x16e41aef93272dae lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93272db5 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790946637.126664:0:15167:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1790946637.126679:0:15167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146be9f7200/0x16e41aef93272dae lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93272db5 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946637.126756:0:15167:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9146be9f7200/0x16e41aef93272dae lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93272db5 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790946637.126763:0:15167:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1790946637.126767:0:15167:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790946637.126771:0:15167:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1790946637.126773:0:15167:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1790946637.126788:0:15167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146be9f7c00/0x16e41aef93272dbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946637.126795:0:15167:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9146be9f7c00/0x16e41aef93272dbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946637.126802:0:15167:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9146be9f7c00/0x16e41aef93272dbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946637.126814:0:15167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914698015500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15167:1877943303368064:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790946637.126838:0:15167:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946637.126938:0:15167:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146becd7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790946637.127548:0:14480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303368064 00000100:00100000:0.0:1790946637.127554:0:14480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303368064 00000100:00100000:0.0:1790946637.127587:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790946637.127595:0:14480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beda1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+13:15167:x1877943303368064:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790946637.127607:0:14480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946637.127617:0:14480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9146b1933800/0x16e41aef93272dc3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x16e41aef93272dbc expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946637.127637:0:14480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9146b1933800/0x16e41aef93272dc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x16e41aef93272dbc expref: 14 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946637.127645:0:14480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9146b1933800/0x16e41aef93272dc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93272dbc expref: 14 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946637.127652:0:14480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b1933800, rc 0) 00000100:00100000:0.0:1790946637.127836:0:14480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beda1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+14:15167:x1877943303368064:12345-0@lo:101:mount.lustre.0 Request processed in 241us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946637.127843:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790946637.127995:0:15167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914698015500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15167:1877943303368064:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790946637.128009:0:15167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9146be9f7c00/0x16e41aef93272dbc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93272dc3 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946637.128018:0:15167:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9146be9f7c00/0x16e41aef93272dbc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93272dc3 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790946637.130023:0:15167:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1790946637.133540:0:15167:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790946637.134559:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1790946637.134633:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1790946637.134668:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1790946637.135635:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1790946637.135690:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1790946637.136725:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1790946637.136826:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1790946637.136834:0:15167:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1790946637.136932:0:15167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5a6b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15167:1877943303368192:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790946637.136999:0:15167:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946637.137150:0:14481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303368192 00000100:00100000:1.0:1790946637.137158:0:14481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303368192 00000100:00100000:1.0:1790946637.137231:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790946637.137241:0:14481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beda2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+14:15167:x1877943303368192:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790946637.137582:0:14481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beda2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+14:15167:x1877943303368192:12345-0@lo:501:mount.lustre.0 Request processed in 343us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946637.137600:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790946637.138275:0:15167:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146879c7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790946637.138302:0:15167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5a6b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15167:1877943303368192:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790946637.138341:0:15167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5a6b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15167:1877943303368320:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790946637.138391:0:15167:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946637.138416:0:15167:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146879c7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790946637.138468:0:14478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303368320 00000100:00100000:1.0:1790946637.138475:0:14478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303368320 00000100:00100000:1.0:1790946637.138513:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790946637.138521:0:14478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beda2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+14:15167:x1877943303368320:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790946637.138842:0:14478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beda2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+14:15167:x1877943303368320:12345-0@lo:503:mount.lustre.0 Request processed in 321us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946637.138850:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790946637.139005:0:15167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5a6b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15167:1877943303368320:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1790946637.140485:0:15167:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790946637.140582:0:15167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914698015500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15167:1877943303368448:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790946637.140648:0:15167:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946637.140747:0:15167:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146becd7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790946637.146152:0:14480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303368448 00000100:00100000:0.0:1790946637.146167:0:14480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303368448 00000100:00100000:0.0:1790946637.146239:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790946637.146250:0:14480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beda2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+14:15167:x1877943303368448:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790946637.146595:0:14480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beda2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+14:15167:x1877943303368448:12345-0@lo:502:mount.lustre.0 Request processed in 346us (5947us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946637.146604:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790946637.146843:0:15167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914698015500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15167:1877943303368448:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790946637.147141:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1790946637.147193:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1790946637.147254:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1790946637.147326:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1790946637.147367:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1790946637.147399:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1790946637.147446:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1790946637.147481:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1790946637.147518:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1790946637.147563:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1790946637.147617:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1790946637.147662:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1790946637.147899:0:15167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914698015500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15167:1877943303368576:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790946637.147959:0:15167:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946637.148004:0:15167:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146becd7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790946637.148754:0:14478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303368576 00000100:00100000:1.0:1790946637.148763:0:14478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303368576 00000100:00100000:1.0:1790946637.148811:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790946637.148819:0:14478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beda3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+14:15167:x1877943303368576:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790946637.149041:0:14478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beda3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+14:15167:x1877943303368576:12345-0@lo:502:mount.lustre.0 Request processed in 222us (1081us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946637.149048:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790946637.150559:0:15167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914698015500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15167:1877943303368576:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790946637.150713:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1790946637.150728:0:15167:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1790946637.158682:0:15181:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790946637.158763:0:15181:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1790946637.158771:0:15181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790946637.158774:0:15181:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1790946637.158780:0:15181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790946637.158796:0:15181:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9146c1ca3380) 00000020:00000080:1.0:1790946637.158818:0:15181:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1790946637.158823:0:15181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1790946637.158884:0:15181:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9146b7977800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1790946637.158893:0:15181:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1790946637.158900:0:15181:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x16e41aef93272dd1 00010000:00010000:1.0:1790946637.171439:0:15181:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1790946637.171840:0:15181:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:1.0:1790946637.173299:0:15181:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1790946637.179239:0:15181:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1790946637.179253:0:15181:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790946637.179260:0:15181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790946637.179262:0:15181:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1790946637.179266:0:15181:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1790946637.179268:0:15181:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:1.0:1790946637.179270:0:15181:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790946637.179271:0:15181:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790946637.179272:0:15181:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1790946637.179274:0:15181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790946637.179276:0:15181:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:1.0:1790946637.179278:0:15181:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790946637.179281:0:15181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790946637.179283:0:15181:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790946637.179285:0:15181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790946637.179287:0:15181:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1790946637.179289:0:15181:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790946637.179292:0:15181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790946637.179293:0:15181:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:1.0:1790946637.179296:0:15181:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790946637.179298:0:15181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790946637.179299:0:15181:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1790946637.179303:0:15181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1790946637.181434:0:15181:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790946637.181450:0:15181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790946637.181452:0:15181:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1790946637.181457:0:15181:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1790946637.183430:0:15167:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1790946637.183471:0:15167:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1790946637.183497:0:15167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146be9f7c00/0x16e41aef93272dbc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93272dc3 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946637.183522:0:15167:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9146be9f7c00/0x16e41aef93272dbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93272dc3 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790946637.183530:0:15167:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9146b7977800 from 1 10000000:01000000:3.0:1790946637.183533:0:15167:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790946637.183567:0:15167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146be9f6e00/0x16e41aef93272dd8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946637.183575:0:15167:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9146be9f6e00/0x16e41aef93272dd8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946637.183585:0:15167:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9146be9f6e00/0x16e41aef93272dd8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946637.183609:0:15167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914698015500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15167:1877943303368704:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790946637.183676:0:15167:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946637.186328:0:15167:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146becd7600 going to sleep for 11 seconds 00000100:00100000:0.0:1790946637.192653:0:14478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303368704 00000100:00100000:0.0:1790946637.192668:0:14478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303368704 00000100:00100000:0.0:1790946637.192793:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790946637.192804:0:14478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beda1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+14:15167:x1877943303368704:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790946637.192836:0:14478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946637.192854:0:14478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9146b1932800/0x16e41aef93272ddf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x16e41aef93272dd8 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946637.192880:0:14478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9146b1932800/0x16e41aef93272ddf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x16e41aef93272dd8 expref: 15 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946637.192891:0:14478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9146b1932800/0x16e41aef93272ddf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93272dd8 expref: 15 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946637.192898:0:14478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b1932800, rc 0) 00000100:00100000:0.0:1790946637.192970:0:14478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beda1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+15:15167:x1877943303368704:12345-0@lo:101:mount.lustre.0 Request processed in 168us (9293us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946637.192977:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790946637.193297:0:15167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914698015500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15167:1877943303368704:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790946637.193396:0:15167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9146be9f6e00/0x16e41aef93272dd8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93272ddf expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946637.193407:0:15167:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9146be9f6e00/0x16e41aef93272dd8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93272ddf expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790946637.194526:0:15167:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1790946637.195861:0:15167:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790946637.196435:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1790946637.196484:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1790946637.196561:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1790946637.196569:0:15167:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1790946637.196655:0:15167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914698015500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15167:1877943303368832:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790946637.196795:0:15167:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946637.196877:0:15167:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146becd7600 going to sleep for 11 seconds 00000100:00100000:2.0:1790946637.196932:0:14481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303368832 00000100:00100000:2.0:1790946637.196940:0:14481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303368832 00000100:00100000:2.0:1790946637.197020:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790946637.197049:0:14481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beda1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+15:15167:x1877943303368832:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790946637.197299:0:14481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beda1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+15:15167:x1877943303368832:12345-0@lo:501:mount.lustre.0 Request processed in 251us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946637.197306:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790946637.197393:0:15167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914698015500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15167:1877943303368832:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790946637.197425:0:15167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914698015500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15167:1877943303368960:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790946637.197468:0:15167:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946637.197814:0:15167:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146becd7600 going to sleep for 11 seconds 00000100:00100000:0.0:1790946637.197882:0:14478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303368960 00000100:00100000:0.0:1790946637.197887:0:14478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303368960 00000100:00100000:0.0:1790946637.197911:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790946637.197918:0:14478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beda1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+15:15167:x1877943303368960:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790946637.198130:0:14478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beda1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+15:15167:x1877943303368960:12345-0@lo:503:mount.lustre.0 Request processed in 212us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946637.198139:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790946637.198467:0:15167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914698015500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15167:1877943303368960:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1790946637.199405:0:15167:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790946637.199486:0:15167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914698015500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15167:1877943303369088:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790946637.199557:0:15167:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946637.199680:0:15167:0:(client.c:2716:ptlrpc_set_wait()) set ffff914699e4a300 going to sleep for 11 seconds 00000100:00100000:1.0:1790946637.199940:0:14480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303369088 00000100:00100000:1.0:1790946637.199949:0:14480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303369088 00000100:00100000:1.0:1790946637.200007:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790946637.200016:0:14480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bc850450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+15:15167:x1877943303369088:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790946637.200255:0:14480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bc850450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+15:15167:x1877943303369088:12345-0@lo:502:mount.lustre.0 Request processed in 239us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946637.200270:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790946637.200468:0:15167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914698015500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15167:1877943303369088:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790946637.200733:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1790946637.200782:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1790946637.200827:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1790946637.200862:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1790946637.200892:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1790946637.200952:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1790946637.200996:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1790946637.201039:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1790946637.201072:0:15167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be98dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15167:1877943303369216:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790946637.201116:0:15167:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946637.201144:0:15167:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146879a9d80 going to sleep for 11 seconds 00000100:00100000:1.0:1790946637.201327:0:14480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303369216 00000100:00100000:1.0:1790946637.201333:0:14480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303369216 00000100:00100000:1.0:1790946637.201359:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1790946637.201365:0:14480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bc850c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+15:15167:x1877943303369216:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790946637.201526:0:14480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bc850c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+15:15167:x1877943303369216:12345-0@lo:502:mount.lustre.0 Request processed in 160us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946637.201533:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790946637.201771:0:15167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be98dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15167:1877943303369216:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790946637.201883:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1790946637.201894:0:15167:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1790946637.202817:0:15185:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790946637.202826:0:15185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790946637.202828:0:15185:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1790946637.202835:0:15185:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9146b7977800 00000020:00000080:0.0:1790946637.202837:0:15185:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790946637.202844:0:15185:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790946637.202847:0:15185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790946637.202848:0:15185:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1790946637.202851:0:15185:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790946637.202853:0:15185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790946637.202855:0:15185:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1790946637.202858:0:15185:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9146b7977800 00000020:00000080:0.0:1790946637.202861:0:15185:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790946637.202918:0:15185:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790946637.202922:0:15185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790946637.202923:0:15185:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1790946637.202925:0:15185:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790946637.202928:0:15185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790946637.202929:0:15185:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1790946637.202932:0:15185:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9146b7977800 00000020:00000080:0.0:1790946637.202934:0:15185:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790946637.202966:0:15185:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790946637.202969:0:15185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790946637.202970:0:15185:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1790946637.202982:0:15185:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1790946637.203844:0:15167:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1790946637.203897:0:15167:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790946637.203915:0:15167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146be9f6e00/0x16e41aef93272dd8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93272ddf expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946637.203927:0:15167:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9146be9f6e00/0x16e41aef93272dd8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93272ddf expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790946637.203972:0:15167:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1790946637.203976:0:15167:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9146b7977800 10000000:01000000:3.0:1790946637.203979:0:15167:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9146b7977800 10000000:01000000:3.0:1790946637.203983:0:15167:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790946637.203988:0:15167:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9146b7977800 from 1 10000000:01000000:3.0:1790946637.203998:0:15167:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790946637.204039:0:15167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146be9f7a00/0x16e41aef93272de6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946637.204048:0:15167:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9146be9f7a00/0x16e41aef93272de6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946637.204061:0:15167:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9146be9f7a00/0x16e41aef93272de6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946637.204083:0:15167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914698014a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15167:1877943303369344:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790946637.204144:0:15167:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946637.204180:0:15167:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146848559c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790946637.205010:0:14478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303369344 00000100:00100000:2.0:1790946637.205020:0:14478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303369344 00000100:00100000:2.0:1790946637.205083:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790946637.205093:0:14478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bc851c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+15:15167:x1877943303369344:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790946637.205107:0:14478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946637.205121:0:14478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff914688aee800/0x16e41aef93272ded lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x16e41aef93272de6 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946637.205147:0:14478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff914688aee800/0x16e41aef93272ded lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x16e41aef93272de6 expref: 16 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946637.205157:0:14478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff914688aee800/0x16e41aef93272ded lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93272de6 expref: 16 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946637.205165:0:14478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914688aee800, rc 0) 00000100:00100000:2.0:1790946637.205898:0:14478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bc851c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+16:15167:x1877943303369344:12345-0@lo:101:mount.lustre.0 Request processed in 803us (1750us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946637.205906:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790946637.211895:0:15167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914698014a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15167:1877943303369344:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790946637.211924:0:15167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9146be9f7a00/0x16e41aef93272de6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93272ded expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946637.211936:0:15167:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9146be9f7a00/0x16e41aef93272de6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93272ded expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790946637.212686:0:15167:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1790946637.213173:0:15167:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790946637.213495:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1790946637.213542:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1790946637.213592:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1790946637.213640:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1790946637.213677:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1790946637.213742:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1790946637.213778:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1790946637.213813:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1790946637.213878:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1790946637.213915:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1790946637.213951:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1790946637.213998:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1790946637.214044:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1790946637.214082:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1790946637.214145:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1790946637.214184:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1790946637.214246:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1790946637.214295:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1790946637.214346:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1790946637.214381:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1790946637.214427:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1790946637.214463:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1790946637.214496:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1790946637.214543:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1790946637.214580:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1790946637.214613:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1790946637.214660:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1790946637.214696:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1790946637.214769:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1790946637.214776:0:15167:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1790946637.214885:0:15167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914698014a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15167:1877943303369472:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790946637.214950:0:15167:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946637.214994:0:15167:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146848559c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790946637.215089:0:14480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303369472 00000100:00100000:0.0:1790946637.215097:0:14480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303369472 00000100:00100000:0.0:1790946637.215142:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790946637.215151:0:14480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bc851450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+16:15167:x1877943303369472:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790946637.215391:0:14480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bc851450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+16:15167:x1877943303369472:12345-0@lo:501:mount.lustre.0 Request processed in 240us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946637.215399:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790946637.221949:0:15167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914698014a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15167:1877943303369472:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790946637.222008:0:15167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914698014a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15167:1877943303369600:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790946637.222093:0:15167:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946637.222143:0:15167:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146848559c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790946637.223231:0:14478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303369600 00000100:00100000:2.0:1790946637.223241:0:14478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303369600 00000100:00100000:2.0:1790946637.223293:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790946637.223302:0:14478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bc853450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+16:15167:x1877943303369600:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790946637.223855:0:14478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bc853450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+16:15167:x1877943303369600:12345-0@lo:503:mount.lustre.0 Request processed in 553us (1761us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946637.223873:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790946637.223930:0:15167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914698014a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15167:1877943303369600:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790946637.230911:0:15167:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790946637.231015:0:15167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5a68380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15167:1877943303369728:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790946637.231103:0:15167:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946637.231804:0:15167:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146879c7840 going to sleep for 11 seconds 00000100:00100000:1.0:1790946637.231886:0:14481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303369728 00000100:00100000:1.0:1790946637.231895:0:14481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303369728 00000100:00100000:1.0:1790946637.231942:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790946637.231951:0:14481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bc853c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+16:15167:x1877943303369728:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790946637.234018:0:14481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bc853c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+16:15167:x1877943303369728:12345-0@lo:502:mount.lustre.0 Request processed in 2059us (2906us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946637.234043:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790946637.237843:0:15167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5a68380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15167:1877943303369728:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790946637.238173:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1790946637.238253:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1790946637.238290:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1790946637.238335:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1790946637.238370:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1790946637.238415:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1790946637.238452:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1790946637.238485:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1790946637.238532:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1790946637.238567:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1790946637.238597:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1790946637.238639:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1790946637.238672:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1790946637.238777:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1790946637.238826:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1790946637.238860:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1790946637.238910:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1790946637.238959:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1790946637.238996:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1790946637.239042:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1790946637.239104:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1790946637.239150:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1790946637.239183:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1790946637.239253:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1790946637.239291:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1790946637.239325:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1790946637.239372:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1790946637.239405:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1790946637.239438:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1790946637.239484:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1790946637.239519:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1790946637.239553:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1790946637.239603:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1790946637.239649:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1790946637.239682:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1790946637.241393:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1790946637.241444:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1790946637.241477:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1790946637.241523:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1790946637.241557:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1790946637.241606:0:15167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5a68380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15167:1877943303369856:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790946637.241684:0:15167:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946637.242961:0:15167:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146879c7840 going to sleep for 11 seconds 00000100:00100000:3.0:1790946637.243315:0:14480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303369856 00000100:00100000:3.0:1790946637.243338:0:14480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303369856 00000100:00100000:3.0:1790946637.243390:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790946637.243399:0:14480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bc853050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+16:15167:x1877943303369856:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790946637.243655:0:14480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bc853050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+16:15167:x1877943303369856:12345-0@lo:502:mount.lustre.0 Request processed in 256us (1970us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946637.243664:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790946637.243819:0:15167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5a68380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15167:1877943303369856:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790946637.243926:0:15167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1790946637.243940:0:15167:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1790946637.252245:0:15190:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1790946637.252264:0:15190:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9146849d8000) 00000020:00000080:0.0:1790946637.252286:0:15190:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1790946637.252368:0:15190:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9146b7977800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1790946637.252372:0:15190:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9146b7977800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1790946637.252375:0:15190:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9146b7977800 3 00010000:00080000:0.0:1790946637.252423:0:15190:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9146a0074000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.113@tcp at head 00010000:00010000:0.0:1790946637.257332:0:15190:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1790946637.257580:0:15190:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1790946637.257616:0:15190:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1790946637.257628:0:15190:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x16e41aef93272dfb 00000100:00080000:0.0:1790946637.257637:0:15190:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790946637.257648:0:15190:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9146a0074000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:0.0:1790946637.257682:0:15190:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9146be98dc00 x1877943303369984/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790946637.258215:0:15190:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1790946637.258238:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790946637.258243:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790946637.258246:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790946637.258255:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1790946637.258302:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be98f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877943303370112:0@lo:400:kworker.0 00000100:00100000:0.0:1790946637.258362:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946637.258508:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be98dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3299:1877943303369984:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790946637.258541:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946637.259286:0:14488:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303370112 00000100:00100000:2.0:1790946637.259296:0:14488:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303370112 00000100:00100000:2.0:1790946637.259333:0:14488:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303369984 00000100:00100000:2.0:1790946637.259342:0:14488:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303369984 00000100:00100000:2.0:1790946637.259362:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790946637.259370:0:14488:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be98c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877943303370112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946637.259427:0:14488:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be98c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1877943303370112:12345-0@lo:400:kworker.0 Request processed in 58us (1064us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946637.259434:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790946637.259452:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790946637.259455:0:14488:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5a68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3299:x1877943303369984:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1790946637.259474:0:14488:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 422 last 0 00000020:00000080:2.0:1790946637.259500:0:14488:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x16e41aef93272e02 00000004:00100000:2.0:1790946637.259513:0:14488:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1790946637.259539:0:14488:0:(import.c:65:import_set_state_nolock()) ffff91458682e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790946637.259575:0:14488:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5a68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1877943303369984:12345-0@lo:38:llog_process_th.0 Request processed in 118us (1033us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946637.259582:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1790946637.259622:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9146be98f100 x1877943303370112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946653 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946637.259635:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be98f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1877943303370112:0@lo:400:kworker.0 00010000:00080000:2.0:1790946637.259665:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9146be98dc00 x1877943303369984/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790946647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946637.259673:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790946637.259679:0:3299:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1790946637.259686:0:3299:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1790946637.259749:0:3299:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1790946637.259752:0:3299:0:(import.c:65:import_set_state_nolock()) ffff9146a0074000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790946637.259764:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be98dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3299:1877943303369984:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1790946637.260913:0:15190:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1790946637.261043:0:15167:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1790946637.261070:0:15167:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790946637.261092:0:15167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146be9f7a00/0x16e41aef93272de6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93272ded expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946637.261103:0:15167:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9146be9f7a00/0x16e41aef93272de6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93272ded expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1790946637.261150:0:15167:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1790946637.261152:0:15167:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790946637.261154:0:15167:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790946637.261155:0:15167:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790946637.261156:0:15167:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790946637.261157:0:15167:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790946637.261159:0:15167:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790946637.261161:0:15167:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790946637.261162:0:15167:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790946637.261166:0:15167:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1790946637.261168:0:15167:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790946637.261170:0:15167:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790946637.261171:0:15167:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790946637.261172:0:15167:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790946637.261173:0:15167:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790946637.261174:0:15167:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790946637.261174:0:15167:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790946637.261175:0:15167:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790946637.261176:0:15167:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790946637.261197:0:15167:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1790946637.261229:0:15167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5a68000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15167:1877943303370240:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790946637.261293:0:15167:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946637.261329:0:15167:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146879c7840 going to sleep for 11 seconds 00000100:00100000:1.0:1790946637.261953:0:14481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303370240 00000100:00100000:1.0:1790946637.261962:0:14481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303370240 00000100:00100000:1.0:1790946637.262011:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790946637.262020:0:14481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bc853850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+16:15167:x1877943303370240:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1790946637.262054:0:14481:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1790946637.262066:0:14481:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1790946637.304054:0:14481:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1790946637.304088:0:14481:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1790946637.304465:0:14502:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1790946637.304470:0:14502:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1790946637.304492:0:14502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9146be9f6c00/0x16e41aef93272e09 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946637.304511:0:14502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9146b1933400/0x16e41aef93272d76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93272d6f expref: 16 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946637.304520:0:14502:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9146be9f6c00/0x16e41aef93272e09 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946637.304559:0:14502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9146b1933400/0x16e41aef93272d76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x16e41aef93272d6f expref: 16 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946637.304574:0:14502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9146b1933400/0x16e41aef93272d76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x16e41aef93272d6f expref: 16 pid: 14480 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946637.304588:0:14502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914698017480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14502:1877943303370368:0@lo:104: 00000100:00100000:3.0:1790946637.304654:0:14502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946637.304784:0:14470:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303370368 00000100:00100000:2.0:1790946637.304792:0:14470:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303370368 00000100:00100000:2.0:1790946637.304830:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790946637.304838:0:14470:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914698014e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+3:14502:x1877943303370368:12345-0@lo:104: 00010000:00010000:2.0:1790946637.304850:0:14470:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9146be9f7e00/0x16e41aef93272d6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93272d76 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946637.304913:0:14470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790946637.304920:0:14470:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914698014e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+3:14502:x1877943303370368:12345-0@lo:104: Request processed in 83us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946637.304927:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1790946637.304949:0:14474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946637.304954:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9146be9f7e00/0x16e41aef93272d6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93272d76 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946637.304961:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146be9f7e00 already unused, calling callback (ffffffffc1d96c20) 10000000:00010000:2.0:1790946637.304964:0:14474:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9146be9f7e00/0x16e41aef93272d6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x16e41aef93272d76 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946637.304972:0:14474:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9146be9f7e00/0x16e41aef93272d6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x16e41aef93272d76 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790946637.304979:0:14474:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9146be9f7e00/0x16e41aef93272d6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x16e41aef93272d76 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790946637.304985:0:14474:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790946637.305011:0:14474:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9146be9f7e00/0x16e41aef93272d6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93272d76 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946637.305018:0:14474:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790946637.305058:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9146be9f7e00/0x16e41aef93272d6f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93272d76 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946637.305065:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9146be9f7e00/0x16e41aef93272d6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93272d76 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946637.305080:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946637.305082:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946637.305084:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946637.305100:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5a6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:3300:1877943303370496:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790946637.305128:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946637.305182:0:14502:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146a035f300 going to sleep for 11 seconds 00000100:00100000:3.0:1790946637.305224:0:14502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914698017480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14502:1877943303370368:0@lo:104: 00010000:00010000:3.0:1790946637.305241:0:14502:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9146be9f6c00/0x16e41aef93272e09 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946637.305666:0:14471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303370496 00000100:00100000:0.0:1790946637.305673:0:14471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303370496 00010000:00010000:0.0:1790946637.305705:0:14471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9146b1933400/0x16e41aef93272d76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef93272d6f expref: 17 pid: 14480 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946637.305732:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790946637.305739:0:14471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5a6b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+17:3300:x1877943303370496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790946637.305750:0:14471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790946637.305754:0:14471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9146b1933400/0x16e41aef93272d76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef93272d6f expref: 17 pid: 14480 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946637.305763:0:14471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9146b1933400/0x16e41aef93272d76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x16e41aef93272d6f expref: 17 pid: 14480 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946637.305777:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9146b1933400/0x16e41aef93272d76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x16e41aef93272d6f expref: 17 pid: 14480 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946637.305789:0:14471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9146be9f6c00/0x16e41aef93272e09 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946637.305798:0:14471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9146be9f6c00/0x16e41aef93272e09 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790946637.305812:0:14471:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001342397s 00010000:00010000:0.0:1790946637.305816:0:14471:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9146be9f6c00/0x16e41aef93272e09 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946637.305833:0:14471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9146be9f6c00/0x16e41aef93272e09 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946637.305840:0:14471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9146be9f6c00/0x16e41aef93272e09 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946637.305846:0:14471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9146be9f6c00/0x16e41aef93272e09 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946637.305851:0:14471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146be9f6c00 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:0.0:1790946637.305856:0:14471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9146be9f6c00/0x16e41aef93272e09 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946637.305863:0:14471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9146be9f6c00/0x16e41aef93272e09 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946637.305877:0:14471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9146be9f6c00/0x16e41aef93272e09 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946637.305886:0:14471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790946637.305921:0:14471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5a6b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+16:3300:x1877943303370496:12345-0@lo:103:ldlm_bl.0 Request processed in 183us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946637.305928:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1790946637.305950:0:14502:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9146be9f6c00/0x16e41aef93272e09 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946637.305957:0:14502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9146be9f6c00/0x16e41aef93272e09 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946637.305963:0:14502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9146be9f6c00/0x16e41aef93272e09 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946637.306012:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5a6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:3300:1877943303370496:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790946637.321010:0:14481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bc853850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+15:15167:x1877943303370240:12345-0@lo:253:mount.lustre.0 Request processed in 58981us (59707us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946637.321037:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790946637.321121:0:15167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5a68000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15167:1877943303370240:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790946637.321137:0:15167:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1790946637.321140:0:15167:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790946637.321142:0:15167:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790946637.321143:0:15167:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790946637.321144:0:15167:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790946637.321145:0:15167:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790946637.321147:0:15167:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790946637.321148:0:15167:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790946637.321150:0:15167:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790946637.321151:0:15167:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1790946637.321165:0:15167:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1790946637.331091:0:15167:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1790946637.331349:0:15167:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1790946637.331519:0:15167:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1790946637.331671:0:15167:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1790946637.331830:0:15167:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1790946637.332048:0:15167:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1790946637.332969:0:15167:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1790946637.383289:0:15167:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1790946637.383313:0:15167:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1790946637.383345:0:15167:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1790946637.383402:0:15167:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.113@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1790946637.383416:0:15167:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1790946637.383442:0:15167:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1790946638.007549:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946639.026389:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1790946639.152429:0:14483:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1790946639.152438:0:14483:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff914586f39800 from 7 10000000:01000000:3.0:1790946639.152442:0:14483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790946639.152487:0:14483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146be9f7800/0x16e41aef93272e10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946639.152499:0:14483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9146be9f7800/0x16e41aef93272e10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946639.152511:0:14483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9146be9f7800/0x16e41aef93272e10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946639.152536:0:14483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914698017480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14483:1877943303370624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790946639.152605:0:14483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946639.152665:0:14483:0:(client.c:2716:ptlrpc_set_wait()) set ffff914682b45e40 going to sleep for 11 seconds 00000100:00100000:1.0:1790946639.153560:0:14480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303370624 00000100:00100000:1.0:1790946639.153570:0:14480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303370624 00000100:00100000:1.0:1790946639.153627:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790946639.153636:0:14480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bc852c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+15:14483:x1877943303370624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790946639.153660:0:14480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946639.153686:0:14480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9146b180ea00/0x16e41aef93272e17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x16e41aef93272e10 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946639.153712:0:14480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9146b180ea00/0x16e41aef93272e17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x16e41aef93272e10 expref: 16 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946639.153722:0:14480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9146b180ea00/0x16e41aef93272e17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93272e10 expref: 16 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946639.153739:0:14480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b180ea00, rc 0) 00000100:00100000:1.0:1790946639.153797:0:14480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bc852c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+16:14483:x1877943303370624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (1192us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946639.153804:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790946639.153854:0:14483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914698017480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14483:1877943303370624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790946639.153882:0:14483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9146be9f7800/0x16e41aef93272e10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93272e17 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946639.153891:0:14483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9146be9f7800/0x16e41aef93272e10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93272e17 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946639.153944:0:14483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91468e93ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14483:1877943303370752:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1790946639.153977:0:14483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946639.154824:0:14483:0:(client.c:2716:ptlrpc_set_wait()) set ffff914584b3cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1790946639.154845:0:14481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303370752 00000100:00100000:1.0:1790946639.154852:0:14481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303370752 00000100:00100000:1.0:1790946639.154903:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790946639.154910:0:14481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bc851850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+16:14483:x1877943303370752:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1790946639.154937:0:14481:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1790946639.154952:0:14481:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790946639.154954:0:14481:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1790946639.155194:0:14481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bc851850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+16:14483:x1877943303370752:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 283us (1214us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946639.155218:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790946639.155259:0:14483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91468e93ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14483:1877943303370752:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1790946639.155459:0:14483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790946639.155468:0:14483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146be9f7800/0x16e41aef93272e10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93272e17 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946639.155479:0:14483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9146be9f7800/0x16e41aef93272e10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93272e17 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946640.054337:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946641.072827:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946642.103840:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790946642.416881:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790946642.416889:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790946642.416893:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790946642.416896:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1790946642.416958:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be98c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:3301:1877943303370880:0@lo:400:kworker.0 00000100:00100000:0.0:1790946642.417099:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946642.417184:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be98f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877943303371008:0@lo:400:kworker.0 00000100:00100000:3.0:1790946642.417227:0:14481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303370880 00000100:00100000:0.0:1790946642.417232:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946642.417238:0:14481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303370880 00000100:00100000:3.0:1790946642.417294:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790946642.417305:0:14481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bc851050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+16:3301:x1877943303370880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946642.417325:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790946642.417331:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be98d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1877943303371136:0@lo:400:kworker.0 00000100:00100000:0.0:1790946642.417359:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946642.417371:0:14481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bc851050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+16:3301:x1877943303370880:12345-0@lo:400:kworker.0 Request processed in 67us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946642.417378:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790946642.417397:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be98c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:3301:1877943303370880:0@lo:400:kworker.0 00000100:00100000:2.0:1790946642.418157:0:14488:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303371008 00000100:00100000:2.0:1790946642.418166:0:14488:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303371008 00000100:00100000:2.0:1790946642.418227:0:14488:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303371136 00000100:00100000:2.0:1790946642.418230:0:14488:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303371136 00000100:00100000:2.0:1790946642.418259:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790946642.418268:0:14488:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be98dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877943303371008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946642.418340:0:14488:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be98dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877943303371008:12345-0@lo:400:kworker.0 Request processed in 74us (1106us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946642.418348:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790946642.418365:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790946642.418371:0:14488:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be98f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877943303371136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946642.418400:0:14488:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be98f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877943303371136:12345-0@lo:400:kworker.0 Request processed in 29us (1040us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946642.418406:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1790946642.418446:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9146be98d500 x1877943303371136/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946658 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946642.418461:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be98d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1877943303371136:0@lo:400:kworker.0 00010000:00080000:2.0:1790946642.418473:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9146be98f480 x1877943303371008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946658 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946642.418482:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be98f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877943303371008:0@lo:400:kworker.0 00000100:00080000:3.0:1790946642.419280:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1790946643.120382:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946644.144873:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790946644.721861:0:14517:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:1.0:1790946644.954783:0:15534:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1790946645.171447:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946646.192609:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946647.217270:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946647.547439:0:3299:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790946632/real 1790946632] req@ffff914698016a00 x1877943303367424/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790946647 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946647.547478:0:3299:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff914698016a00 x1877943303367424/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790946647 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946647.547488:0:3299:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790946632/real 1790946632] req@ffff914698016300 x1877943303367552/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790946647 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946647.547499:0:3299:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff914698016300 x1877943303367552/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790946647 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790946647.547523:0:3299:0:(import.c:65:import_set_state_nolock()) ffff9146b581e800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790946647.547559:0:3299:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1790946647.547563:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914698016a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1877943303367424:0@lo:8:kworker.0 00000100:00080000:3.0:1790946647.547570:0:3299:0:(import.c:65:import_set_state_nolock()) ffff9146851e9000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790946647.547575:0:3299:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1790946647.547578:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914698016300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1877943303367552:0@lo:8:kworker.0 00000100:00080000:1.0:1790946647.547782:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790946647.547788:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1790946647.547791:0:8:0:(import.c:65:import_set_state_nolock()) ffff9146b581e800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790946647.547796:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 417 00000100:00080000:1.0:1790946647.547803:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1790946647.547818:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9146b581e800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:1.0:1790946647.547842:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91468e93dc00 x1877943303371392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790946647.547868:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790946647.547871:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1790946647.547873:0:8:0:(import.c:65:import_set_state_nolock()) ffff9146851e9000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790946647.547877:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 417 00000100:00080000:1.0:1790946647.547880:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1790946647.547885:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9146851e9000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:1.0:1790946647.547897:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91468e93c380 x1877943303371520/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790946647.547963:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91468e93c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1877943303371648:0@lo:400:kworker.0 00000100:00100000:1.0:1790946647.548048:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946647.548123:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790946647.548131:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91468e93ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:3301:1877943303371264:0@lo:400:kworker.0 00000100:00100000:1.0:1790946647.548161:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946647.548191:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91468e93dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1877943303371392:0@lo:8:kworker.0 00000100:00100000:1.0:1790946647.548249:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946647.548269:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91468e93c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1877943303371520:0@lo:8:kworker.0 00000100:00100000:1.0:1790946647.548294:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946647.548478:0:15170:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303371392 00000100:00100000:3.0:1790946647.548488:0:15170:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303371392 00000100:00100000:3.0:1790946647.548531:0:15170:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303371520 00000100:00100000:3.0:1790946647.548534:0:15170:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303371520 00000100:00100000:3.0:1790946647.548548:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790946647.548556:0:15170:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468e93f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3299:x1877943303371392:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1790946647.548591:0:15170:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 432 last 0 00000020:00000080:3.0:1790946647.548628:0:15170:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x16e41aef93272e1e 00002000:00100000:3.0:1790946647.548646:0:15170:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9146b665a000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b03 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1790946647.548651:0:15170:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1790946647.548664:0:15170:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1790946647.549088:0:15170:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1790946647.549119:0:15170:0:(import.c:65:import_set_state_nolock()) ffff9146b665d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790946647.549227:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91468e93df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1877943303371776:0@lo:400:kworker.0 00000100:00100000:3.0:1790946647.563509:0:15170:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468e93f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3299:x1877943303371392:12345-0@lo:8:kworker.0 Request processed in 14937us (15242us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946647.563529:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1790946647.563856:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91468e93dc00 x1877943303371392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790946667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946647.563871:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790946647.563885:0:3299:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1790946647.563897:0:3299:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1790946647.563904:0:3299:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1790946647.563908:0:3299:0:(import.c:65:import_set_state_nolock()) ffff9146b581e800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1790946647.563934:0:3299:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1790946647.563942:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91468e93dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1877943303371392:0@lo:8:kworker.0 00000004:00080000:3.0:1790946647.563996:0:14508:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1790946647.565410:0:14509:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:1.0:1790946647.565439:0:14509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91468e93e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14509:1877943303372032:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1790946647.565511:0:14509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946647.565549:0:14509:0:(client.c:2716:ptlrpc_set_wait()) set ffff914690149840 going to sleep for 11 seconds 00000100:00100000:1.0:1790946647.565583:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91468e93c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303371904:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790946647.565623:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946647.565668:0:14488:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303371648 00000100:00100000:1.0:1790946647.565677:0:14488:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303371648 00000100:00100000:1.0:1790946647.565733:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790946647.565743:0:14488:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468e93f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1877943303371648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946647.565806:0:14488:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468e93f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1877943303371648:12345-0@lo:400:kworker.0 Request processed in 64us (17758us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946647.565814:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790946647.565842:0:14478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303371264 00000100:00100000:1.0:1790946647.565846:0:14478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303371264 00000100:00100000:1.0:1790946647.565876:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790946647.565882:0:14478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bc852450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+16:3301:x1877943303371264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946647.565915:0:14478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bc852450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+16:3301:x1877943303371264:12345-0@lo:400:kworker.0 Request processed in 33us (17753us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946647.565921:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790946647.565971:0:15168:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303372032 00000100:00100000:1.0:1790946647.565975:0:15168:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303372032 00000100:00100000:1.0:1790946647.566008:0:15168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790946647.566013:0:15168:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468e93d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3299:x1877943303371520:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1790946647.566034:0:15168:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1790946647.566072:0:15168:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468e93d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3299:x1877943303371520:12345-0@lo:8:kworker.0 Request processed in 58us (17776us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790946647.566078:0:15168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790946647.566100:0:15168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790946647.566105:0:15168:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468e93f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14509:x1877943303372032:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:2.0:1790946647.567999:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790946647.568091:0:3299:0:(import.c:65:import_set_state_nolock()) ffff9146851e9000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790946647.568103:0:3299:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790946647.568110:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91468e93c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1877943303371520:0@lo:8:kworker.0 00000004:00080000:2.0:1790946647.586009:0:14508:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 432657803578ns, next at 0ns, rc = 0 00000100:00100000:3.0:1790946647.589573:0:15172:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303371904 00000100:00100000:3.0:1790946647.589593:0:15172:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303371904 00000100:00100000:3.0:1790946647.589668:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790946647.589682:0:15172:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468e93dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1877943303371904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790946647.591369:0:15172:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790946647.591514:0:15172:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468e93dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1877943303371904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1831us (25885us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946647.591526:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790946647.592345:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91468e93ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:3301:1877943303371264:0@lo:400:kworker.0 00010000:00080000:0.0:1790946647.592370:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91468e93c000 x1877943303371648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946663 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946647.592386:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91468e93c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1877943303371648:0@lo:400:kworker.0 00000100:00100000:0.0:1790946647.592478:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946647.592526:0:14487:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303371776 00000100:00100000:0.0:1790946647.592534:0:14487:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303371776 00000100:00100000:0.0:1790946647.592603:0:14487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790946647.592613:0:14487:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be98c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877943303371776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946647.592669:0:14487:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be98c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877943303371776:12345-0@lo:400:kworker.0 Request processed in 58us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946647.592677:0:14487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1790946647.592700:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1790946647.592721:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91468e93df80 x1877943303371776/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946663 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946647.592731:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91468e93df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1877943303371776:0@lo:400:kworker.0 00010000:00080000:0.0:1790946647.592773:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91468e93c700 x1877943303371904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790946663 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946647.592794:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91468e93c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303371904:0@lo:13:osp-pre-0-0.0 00002000:00080000:1.0:1790946647.593259:0:15168:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1790946647.593275:0:15168:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1790946647.593281:0:15168:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:1.0:1790946647.623694:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790946647.623712:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082fd253f/0x16e41aef93272e25 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.623735:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=432s v=(0 0) 00010000:00010000:1.0:1790946647.623741:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946647.623748:0:15168:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082fd253f/0x16e41aef93272e25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.623771:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082fd253f/0x16e41aef93272e25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.623783:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082fd253f/0x16e41aef93272e25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.623792:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082fd253f/0x16e41aef93272e25 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.623817:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1790946647.624425:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790946647.624433:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af644160/0x16e41aef93272e2c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.624444:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=432s v=(0 0) 00010000:00010000:1.0:1790946647.624447:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946647.624452:0:15168:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af644160/0x16e41aef93272e2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.624470:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af644160/0x16e41aef93272e2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.624479:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af644160/0x16e41aef93272e2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.624487:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af644160/0x16e41aef93272e2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.624509:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1790946647.624905:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790946647.624911:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb13ef42/0x16e41aef93272e33 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.624920:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=432s v=(0 0) 00010000:00010000:1.0:1790946647.624923:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946647.624927:0:15168:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb13ef42/0x16e41aef93272e33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.624936:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb13ef42/0x16e41aef93272e33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.624945:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb13ef42/0x16e41aef93272e33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.629498:0:14475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790946647.629519:0:14475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082fd253f/0x16e41aef93272e25 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.629537:0:14475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180fa00 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:0.0:1790946647.629543:0:14475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082fd253f/0x16e41aef93272e25 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.629556:0:14475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082fd253f/0x16e41aef93272e25 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.629591:0:14475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082fd253f/0x16e41aef93272e25 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.629619:0:14475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082fd253f/0x16e41aef93272e25 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.629654:0:14475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790946647.629658:0:14475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af644160/0x16e41aef93272e2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.629665:0:14475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180fe00 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:0.0:1790946647.629668:0:14475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af644160/0x16e41aef93272e2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.629676:0:14475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af644160/0x16e41aef93272e2c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.629687:0:14475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af644160/0x16e41aef93272e2c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.629695:0:14475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af644160/0x16e41aef93272e2c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.629708:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946647.629710:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946647.629712:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946647.629977:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946647.631861:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb13ef42/0x16e41aef93272e33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.631894:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1790946647.652594:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790946647.652612:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e13b794/0x16e41aef93272e3a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.652637:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=432s v=(0 0) 00010000:00010000:1.0:1790946647.652643:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946647.652663:0:15168:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e13b794/0x16e41aef93272e3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.652682:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e13b794/0x16e41aef93272e3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.652706:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e13b794/0x16e41aef93272e3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.652726:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e13b794/0x16e41aef93272e3a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.652763:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1790946647.653416:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790946647.653426:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6f82bba/0x16e41aef93272e41 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.653447:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=432s v=(0 0) 00010000:00010000:1.0:1790946647.653451:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946647.653457:0:15168:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6f82bba/0x16e41aef93272e41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.653469:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6f82bba/0x16e41aef93272e41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.653478:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6f82bba/0x16e41aef93272e41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.653486:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6f82bba/0x16e41aef93272e41 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.653496:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1790946647.654096:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790946647.654112:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087470073/0x16e41aef93272e48 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.654123:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=432s v=(0 0) 00010000:00010000:1.0:1790946647.654126:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946647.654131:0:15168:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087470073/0x16e41aef93272e48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.654155:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087470073/0x16e41aef93272e48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.654176:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087470073/0x16e41aef93272e48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.654184:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087470073/0x16e41aef93272e48 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.654193:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1790946647.654715:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790946647.654731:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000291eb6b/0x16e41aef93272e4f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.654743:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=432s v=(0 0) 00010000:00010000:1.0:1790946647.654747:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946647.654751:0:15168:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000291eb6b/0x16e41aef93272e4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.654776:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000291eb6b/0x16e41aef93272e4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.654785:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000291eb6b/0x16e41aef93272e4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.654794:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000291eb6b/0x16e41aef93272e4f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.654814:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:2.0:1790946647.659436:0:14474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1790946647.659453:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb13ef42/0x16e41aef93272e33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946647.659470:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180e000 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:2.0:1790946647.659476:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb13ef42/0x16e41aef93272e33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946647.659489:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb13ef42/0x16e41aef93272e33 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946647.659518:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb13ef42/0x16e41aef93272e33 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946647.659527:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb13ef42/0x16e41aef93272e33 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946647.659551:0:14474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1790946647.659555:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e13b794/0x16e41aef93272e3a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946647.659572:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180f200 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:2.0:1790946647.659576:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e13b794/0x16e41aef93272e3a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946647.659583:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e13b794/0x16e41aef93272e3a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946647.659592:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e13b794/0x16e41aef93272e3a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946647.659598:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e13b794/0x16e41aef93272e3a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946647.659616:0:14474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790946647.659619:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6f82bba/0x16e41aef93272e41 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946647.659626:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180e200 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:2.0:1790946647.659629:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6f82bba/0x16e41aef93272e41 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946647.659637:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6f82bba/0x16e41aef93272e41 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946647.659646:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6f82bba/0x16e41aef93272e41 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946647.659661:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6f82bba/0x16e41aef93272e41 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946647.659675:0:14474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790946647.659679:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087470073/0x16e41aef93272e48 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946647.659685:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180f800 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:2.0:1790946647.659689:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087470073/0x16e41aef93272e48 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946647.659696:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087470073/0x16e41aef93272e48 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946647.659707:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087470073/0x16e41aef93272e48 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946647.659714:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087470073/0x16e41aef93272e48 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946647.659730:0:14474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946647.659733:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000291eb6b/0x16e41aef93272e4f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946647.659741:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180f000 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:2.0:1790946647.659749:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000291eb6b/0x16e41aef93272e4f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946647.659758:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000291eb6b/0x16e41aef93272e4f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946647.659768:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000291eb6b/0x16e41aef93272e4f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946647.659775:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000291eb6b/0x16e41aef93272e4f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946647.659789:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946647.659791:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946647.659793:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946647.659802:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790946647.664495:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790946647.664512:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067644636/0x16e41aef93272e56 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.664534:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=432s v=(0 0) 00010000:00010000:1.0:1790946647.664539:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946647.664547:0:15168:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067644636/0x16e41aef93272e56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.664564:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067644636/0x16e41aef93272e56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.664576:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067644636/0x16e41aef93272e56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.664587:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067644636/0x16e41aef93272e56 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.664610:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790946647.664624:0:14474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790946647.664631:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067644636/0x16e41aef93272e56 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.664640:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180fc00 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:1.0:1790946647.664653:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067644636/0x16e41aef93272e56 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.664664:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067644636/0x16e41aef93272e56 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.664686:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067644636/0x16e41aef93272e56 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.664695:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067644636/0x16e41aef93272e56 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.664722:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946647.664724:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946647.664726:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790946647.670717:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790946647.670737:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004357f1f7/0x16e41aef93272e5d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.670760:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=432s v=(0 0) 00010000:00010000:1.0:1790946647.670765:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946647.670772:0:15168:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004357f1f7/0x16e41aef93272e5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.670789:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004357f1f7/0x16e41aef93272e5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.670800:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004357f1f7/0x16e41aef93272e5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.670823:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004357f1f7/0x16e41aef93272e5d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.670849:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790946647.672295:0:14475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790946647.672765:0:14475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004357f1f7/0x16e41aef93272e5d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.672790:0:14475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180e600 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:0.0:1790946647.672795:0:14475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004357f1f7/0x16e41aef93272e5d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.672808:0:14475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004357f1f7/0x16e41aef93272e5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.672833:0:14475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004357f1f7/0x16e41aef93272e5d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.672841:0:14475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004357f1f7/0x16e41aef93272e5d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.672870:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946647.672872:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946647.672874:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790946647.673982:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790946647.673997:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000285836a5/0x16e41aef93272e64 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.674015:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=432s v=(0 0) 00010000:00010000:1.0:1790946647.674020:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946647.674028:0:15168:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000285836a5/0x16e41aef93272e64 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.674042:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000285836a5/0x16e41aef93272e64 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.674054:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000285836a5/0x16e41aef93272e64 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.674062:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000285836a5/0x16e41aef93272e64 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.674086:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790946647.674101:0:14474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790946647.674106:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000285836a5/0x16e41aef93272e64 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.674121:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914680030e00 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:1.0:1790946647.674125:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000285836a5/0x16e41aef93272e64 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.674135:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000285836a5/0x16e41aef93272e64 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.674150:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000285836a5/0x16e41aef93272e64 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.674157:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000285836a5/0x16e41aef93272e64 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.674178:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946647.674179:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946647.674181:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1790946647.676485:0:6700:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:3.0:1790946647.691998:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790946647.692019:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e4f8443/0x16e41aef93272e6b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946647.692049:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1790946647.692055:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790946647.692063:0:15168:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e4f8443/0x16e41aef93272e6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946647.692082:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e4f8443/0x16e41aef93272e6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946647.692094:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e4f8443/0x16e41aef93272e6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946647.692104:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e4f8443/0x16e41aef93272e6b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946647.692142:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790946647.692162:0:14475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790946647.692170:0:14475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e4f8443/0x16e41aef93272e6b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946647.692180:0:14475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146be9f7000 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:3.0:1790946647.692185:0:14475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e4f8443/0x16e41aef93272e6b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946647.692195:0:14475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e4f8443/0x16e41aef93272e6b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946647.693986:0:14475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e4f8443/0x16e41aef93272e6b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946647.694005:0:14475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e4f8443/0x16e41aef93272e6b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946647.694032:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946647.694035:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946647.694038:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790946647.701316:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790946647.701335:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005dadd0c0/0x16e41aef93272e72 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946647.701358:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1790946647.701363:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790946647.701370:0:15168:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005dadd0c0/0x16e41aef93272e72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946647.701454:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005dadd0c0/0x16e41aef93272e72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946647.701467:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005dadd0c0/0x16e41aef93272e72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946647.701476:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005dadd0c0/0x16e41aef93272e72 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946647.701527:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790946647.701793:0:14474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790946647.701803:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005dadd0c0/0x16e41aef93272e72 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.701814:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146be9f6600 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:0.0:1790946647.701821:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005dadd0c0/0x16e41aef93272e72 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.701832:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005dadd0c0/0x16e41aef93272e72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.701863:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005dadd0c0/0x16e41aef93272e72 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.701871:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005dadd0c0/0x16e41aef93272e72 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.708353:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946647.708361:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946647.708364:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1790946647.718711:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:2.0:1790946647.719793:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790946647.719806:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db928b4a/0x16e41aef93272e79 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946647.719829:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=432s v=(0 0) 00010000:00010000:2.0:1790946647.719834:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790946647.719842:0:15168:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db928b4a/0x16e41aef93272e79 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946647.719859:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db928b4a/0x16e41aef93272e79 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946647.719882:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db928b4a/0x16e41aef93272e79 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946647.719890:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db928b4a/0x16e41aef93272e79 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946647.719917:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790946647.719966:0:14475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790946647.719977:0:14475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db928b4a/0x16e41aef93272e79 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946647.719986:0:14475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aee000 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:3.0:1790946647.719993:0:14475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db928b4a/0x16e41aef93272e79 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946647.720003:0:14475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db928b4a/0x16e41aef93272e79 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946647.720026:0:14475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db928b4a/0x16e41aef93272e79 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946647.720035:0:14475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db928b4a/0x16e41aef93272e79 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946647.720060:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946647.720062:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946647.720064:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790946647.720482:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790946647.720489:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e2c9255/0x16e41aef93272e80 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946647.720499:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=432s v=(0 0) 00010000:00010000:2.0:1790946647.720502:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790946647.720513:0:15168:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e2c9255/0x16e41aef93272e80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946647.720523:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e2c9255/0x16e41aef93272e80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946647.720532:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e2c9255/0x16e41aef93272e80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946647.720539:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e2c9255/0x16e41aef93272e80 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946647.720569:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790946647.721171:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790946647.721177:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000df72a86/0x16e41aef93272e87 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946647.721188:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=432s v=(0 0) 00010000:00010000:2.0:1790946647.721191:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790946647.721195:0:15168:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000df72a86/0x16e41aef93272e87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946647.721233:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000df72a86/0x16e41aef93272e87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946647.721242:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000df72a86/0x16e41aef93272e87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946647.721250:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000df72a86/0x16e41aef93272e87 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946647.721264:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1790946647.721293:0:14475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790946647.721302:0:14475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e2c9255/0x16e41aef93272e80 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946647.721325:0:14475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aeea00 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:3.0:1790946647.721329:0:14475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e2c9255/0x16e41aef93272e80 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946647.721340:0:14475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e2c9255/0x16e41aef93272e80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946647.721356:0:14475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e2c9255/0x16e41aef93272e80 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946647.721365:0:14475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e2c9255/0x16e41aef93272e80 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946647.721401:0:14475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790946647.721413:0:14475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000df72a86/0x16e41aef93272e87 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946647.721421:0:14475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aefc00 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:3.0:1790946647.721425:0:14475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000df72a86/0x16e41aef93272e87 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946647.721433:0:14475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000df72a86/0x16e41aef93272e87 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946647.721446:0:14475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000df72a86/0x16e41aef93272e87 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946647.721462:0:14475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000df72a86/0x16e41aef93272e87 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946647.721620:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946647.721623:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946647.721626:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790946647.721789:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790946647.721808:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054afdcff/0x16e41aef93272e8e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946647.721817:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=432s v=(0 0) 00010000:00010000:2.0:1790946647.721827:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790946647.721832:0:15168:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054afdcff/0x16e41aef93272e8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946647.721841:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054afdcff/0x16e41aef93272e8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946647.721849:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054afdcff/0x16e41aef93272e8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946647.721858:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054afdcff/0x16e41aef93272e8e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946647.721877:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790946647.721885:0:14475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790946647.721891:0:14475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054afdcff/0x16e41aef93272e8e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946647.721900:0:14475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aef600 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:3.0:1790946647.721904:0:14475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054afdcff/0x16e41aef93272e8e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946647.721913:0:14475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054afdcff/0x16e41aef93272e8e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946647.721926:0:14475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054afdcff/0x16e41aef93272e8e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946647.721933:0:14475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054afdcff/0x16e41aef93272e8e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946647.721962:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946647.721964:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946647.721966:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946647.723326:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790946647.728070:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790946647.728093:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085a6e26c/0x16e41aef93272e95 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946647.728118:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=432s v=(0 0) 00010000:00010000:2.0:1790946647.728123:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790946647.728131:0:15168:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085a6e26c/0x16e41aef93272e95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946647.728149:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085a6e26c/0x16e41aef93272e95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946647.728162:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085a6e26c/0x16e41aef93272e95 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946647.728181:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085a6e26c/0x16e41aef93272e95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946647.729103:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790946647.733013:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790946647.733030:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5a9b7d2/0x16e41aef93272e9c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946647.733052:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=432s v=(0 0) 00010000:00010000:2.0:1790946647.733057:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790946647.733064:0:15168:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5a9b7d2/0x16e41aef93272e9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946647.733081:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5a9b7d2/0x16e41aef93272e9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946647.733093:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5a9b7d2/0x16e41aef93272e9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946647.733103:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f5a9b7d2/0x16e41aef93272e9c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.742906:0:14475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790946647.742928:0:14475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085a6e26c/0x16e41aef93272e95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.742954:0:14475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aeec00 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:0.0:1790946647.742961:0:14475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085a6e26c/0x16e41aef93272e95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.742974:0:14475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085a6e26c/0x16e41aef93272e95 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.743003:0:14475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085a6e26c/0x16e41aef93272e95 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.743010:0:14475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085a6e26c/0x16e41aef93272e95 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.743245:0:14475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790946647.743251:0:14475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5a9b7d2/0x16e41aef93272e9c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.743259:0:14475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aee600 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:0.0:1790946647.743262:0:14475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5a9b7d2/0x16e41aef93272e9c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.743272:0:14475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5a9b7d2/0x16e41aef93272e9c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.743285:0:14475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5a9b7d2/0x16e41aef93272e9c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.743293:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946647.743295:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946647.743298:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946647.743743:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1790946647.743754:0:15168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5a9b7d2/0x16e41aef93272e9c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.747685:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790946647.748736:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790946647.748750:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096ff96ca/0x16e41aef93272ea3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.748772:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=432s v=(0 0) 00010000:00010000:0.0:1790946647.748778:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946647.748786:0:15168:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096ff96ca/0x16e41aef93272ea3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.748815:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096ff96ca/0x16e41aef93272ea3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.748829:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096ff96ca/0x16e41aef93272ea3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.748839:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096ff96ca/0x16e41aef93272ea3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.748874:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790946647.749463:0:14475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946647.749476:0:14475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096ff96ca/0x16e41aef93272ea3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946647.749488:0:14475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1933000 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:2.0:1790946647.749494:0:14475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096ff96ca/0x16e41aef93272ea3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946647.749506:0:14475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096ff96ca/0x16e41aef93272ea3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946647.749529:0:14475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096ff96ca/0x16e41aef93272ea3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946647.749538:0:14475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096ff96ca/0x16e41aef93272ea3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946647.749562:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946647.749564:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946647.749567:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790946647.749867:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790946647.749875:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2ec06ae/0x16e41aef93272eaa lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.749886:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=432s v=(0 0) 00010000:00010000:0.0:1790946647.749890:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946647.749894:0:15168:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ec06ae/0x16e41aef93272eaa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.749904:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ec06ae/0x16e41aef93272eaa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.749912:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2ec06ae/0x16e41aef93272eaa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.749930:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ec06ae/0x16e41aef93272eaa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.749995:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790946647.751667:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790946647.751681:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c05707f1/0x16e41aef93272eb1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.751701:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=432s v=(0 0) 00010000:00010000:0.0:1790946647.751705:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946647.751713:0:15168:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c05707f1/0x16e41aef93272eb1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.751728:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c05707f1/0x16e41aef93272eb1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.751739:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c05707f1/0x16e41aef93272eb1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.751749:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c05707f1/0x16e41aef93272eb1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946647.759688:0:14474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790946647.759707:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2ec06ae/0x16e41aef93272eaa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946647.759725:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1932a00 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:2.0:1790946647.759739:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ec06ae/0x16e41aef93272eaa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946647.759753:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2ec06ae/0x16e41aef93272eaa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946647.759781:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2ec06ae/0x16e41aef93272eaa lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946647.759789:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ec06ae/0x16e41aef93272eaa lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.760360:0:14474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790946647.760370:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c05707f1/0x16e41aef93272eb1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.760574:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1933200 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:1.0:1790946647.760578:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c05707f1/0x16e41aef93272eb1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.760589:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c05707f1/0x16e41aef93272eb1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.760613:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c05707f1/0x16e41aef93272eb1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.760623:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946647.760625:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946647.760627:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946647.773243:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946647.773247:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1790946647.773263:0:15168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c05707f1/0x16e41aef93272eb1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790946647.777991:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790946647.778010:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000285836a5/0x16e41aef93272eb8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.778033:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=432s v=(0 0) 00010000:00010000:1.0:1790946647.778038:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946647.778046:0:15168:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000285836a5/0x16e41aef93272eb8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.778063:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000285836a5/0x16e41aef93272eb8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.778467:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000285836a5/0x16e41aef93272eb8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.778477:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000285836a5/0x16e41aef93272eb8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.778637:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790946647.778669:0:14474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790946647.778680:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000285836a5/0x16e41aef93272eb8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.778691:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914680030e00 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:0.0:1790946647.778696:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000285836a5/0x16e41aef93272eb8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.778709:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000285836a5/0x16e41aef93272eb8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.778731:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000285836a5/0x16e41aef93272eb8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.778740:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000285836a5/0x16e41aef93272eb8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.778763:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946647.778765:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946647.778767:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790946647.779443:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790946647.779452:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028464bdd/0x16e41aef93272ebf lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.779465:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=432s v=(0 0) 00010000:00010000:1.0:1790946647.779469:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946647.779475:0:15168:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028464bdd/0x16e41aef93272ebf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.779487:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028464bdd/0x16e41aef93272ebf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.779496:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028464bdd/0x16e41aef93272ebf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.779503:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028464bdd/0x16e41aef93272ebf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.779528:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790946647.779657:0:14475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790946647.779665:0:14475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028464bdd/0x16e41aef93272ebf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.779675:0:14475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914680031c00 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:0.0:1790946647.779686:0:14475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028464bdd/0x16e41aef93272ebf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.779697:0:14475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028464bdd/0x16e41aef93272ebf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.779713:0:14475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028464bdd/0x16e41aef93272ebf lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.779722:0:14475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028464bdd/0x16e41aef93272ebf lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.779743:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946647.779746:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946647.779748:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790946647.779979:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790946647.779985:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f1d4bbf/0x16e41aef93272ec6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.779994:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=432s v=(0 0) 00010000:00010000:1.0:1790946647.779997:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946647.780000:0:15168:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f1d4bbf/0x16e41aef93272ec6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.780022:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f1d4bbf/0x16e41aef93272ec6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.780031:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f1d4bbf/0x16e41aef93272ec6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.780039:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000f1d4bbf/0x16e41aef93272ec6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.780060:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790946647.780093:0:14474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790946647.780099:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000f1d4bbf/0x16e41aef93272ec6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.780108:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914680030800 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:0.0:1790946647.780111:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000f1d4bbf/0x16e41aef93272ec6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.780120:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000f1d4bbf/0x16e41aef93272ec6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.780143:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000f1d4bbf/0x16e41aef93272ec6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.780158:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f1d4bbf/0x16e41aef93272ec6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.780177:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946647.780179:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946647.780182:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790946647.780518:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790946647.780525:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d54e189a/0x16e41aef93272ecd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.780533:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=432s v=(0 0) 00010000:00010000:1.0:1790946647.780536:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946647.780540:0:15168:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d54e189a/0x16e41aef93272ecd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.780550:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d54e189a/0x16e41aef93272ecd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.780559:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d54e189a/0x16e41aef93272ecd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.780579:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d54e189a/0x16e41aef93272ecd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.780600:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790946647.780871:0:14475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790946647.780878:0:14475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d54e189a/0x16e41aef93272ecd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.780888:0:14475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914680031e00 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:0.0:1790946647.780892:0:14475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d54e189a/0x16e41aef93272ecd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.780902:0:14475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d54e189a/0x16e41aef93272ecd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.780917:0:14475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d54e189a/0x16e41aef93272ecd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.780927:0:14475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d54e189a/0x16e41aef93272ecd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.780956:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946647.780958:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946647.780960:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790946647.783256:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790946647.783274:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e4f8443/0x16e41aef93272ed4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946647.783296:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1790946647.783301:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790946647.783309:0:15168:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e4f8443/0x16e41aef93272ed4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946647.783323:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e4f8443/0x16e41aef93272ed4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946647.783333:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e4f8443/0x16e41aef93272ed4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946647.783342:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e4f8443/0x16e41aef93272ed4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946647.783368:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790946647.783504:0:14474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790946647.783514:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e4f8443/0x16e41aef93272ed4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.783524:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146be9f7000 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:1.0:1790946647.783530:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e4f8443/0x16e41aef93272ed4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.783540:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e4f8443/0x16e41aef93272ed4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.783562:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e4f8443/0x16e41aef93272ed4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.783571:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e4f8443/0x16e41aef93272ed4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.783593:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946647.783596:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946647.783597:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790946647.789999:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790946647.790020:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbec824f/0x16e41aef93272edb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946647.790045:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1790946647.790050:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790946647.790058:0:15168:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dbec824f/0x16e41aef93272edb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946647.790465:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dbec824f/0x16e41aef93272edb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946647.790479:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbec824f/0x16e41aef93272edb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946647.790489:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dbec824f/0x16e41aef93272edb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946647.790515:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790946647.791540:0:14475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790946647.791552:0:14475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dbec824f/0x16e41aef93272edb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.791565:0:14475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146be9f7600 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:0.0:1790946647.791571:0:14475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbec824f/0x16e41aef93272edb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.791582:0:14475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbec824f/0x16e41aef93272edb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.791604:0:14475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dbec824f/0x16e41aef93272edb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.791612:0:14475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dbec824f/0x16e41aef93272edb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946647.791636:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946647.791638:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946647.791640:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790946647.793729:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790946647.793744:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7836b3d/0x16e41aef93272ee2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946647.793764:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1790946647.793769:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790946647.793776:0:15168:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7836b3d/0x16e41aef93272ee2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946647.793792:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7836b3d/0x16e41aef93272ee2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946647.793866:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7836b3d/0x16e41aef93272ee2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946647.793888:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7836b3d/0x16e41aef93272ee2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946647.793954:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1790946647.794340:0:15168:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:3.0:1790946647.794481:0:15168:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468e93f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:14509:x1877943303372032:12345-0@lo:5:osp-pre-0-0.0 Request processed in 228368us (228963us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946647.794493:0:15168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790946647.794564:0:14509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91468e93e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14509:1877943303372032:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1790946647.794585:0:14509:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:3.0:1790946647.794647:0:14509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914698016300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14509:1877943303372160:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1790946647.794689:0:14509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946647.794742:0:14509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146a012a240 going to sleep for 11 seconds 00000100:00100000:3.0:1790946647.794773:0:15168:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303372160 00000100:00100000:3.0:1790946647.794781:0:15168:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303372160 00000100:00100000:3.0:1790946647.794847:0:15171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790946647.794857:0:15171:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914698016a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:14509:x1877943303372160:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1790946647.794908:0:15171:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:1.0:1790946647.799432:0:14474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790946647.799449:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7836b3d/0x16e41aef93272ee2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.799477:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146be9f6a00 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:1.0:1790946647.799482:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7836b3d/0x16e41aef93272ee2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.799495:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7836b3d/0x16e41aef93272ee2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.799522:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7836b3d/0x16e41aef93272ee2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.799530:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7836b3d/0x16e41aef93272ee2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946647.800568:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946647.800572:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946647.800574:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946647.803065:0:15171:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914698016a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14509:x1877943303372160:12345-0@lo:5:osp-pre-0-0.0 Request processed in 8199us (8366us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1790946647.803155:0:15171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790946647.803502:0:14509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914698016300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14509:1877943303372160:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1790946647.803522:0:14509:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:0.0:1790946648.247817:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946649.269845:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946650.289129:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946651.317782:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946652.336484:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946652.656569:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5a68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:3300:1877943303372288:0@lo:400:kworker.0 00000100:00100000:3.0:1790946652.656751:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946652.656871:0:14480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303372288 00000100:00100000:1.0:1790946652.656883:0:14480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303372288 00000100:00100000:1.0:1790946652.656976:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1790946652.656986:0:14480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bc850050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+16:3300:x1877943303372288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946652.660264:0:14480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bc850050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+16:3300:x1877943303372288:12345-0@lo:400:kworker.0 Request processed in 3267us (3501us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946652.660281:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790946652.660434:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5a68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:3300:1877943303372288:0@lo:400:kworker.0 00000100:00100000:3.0:1790946652.660464:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790946652.660476:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5a6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303372416:0@lo:400:kworker.0 00000100:00100000:3.0:1790946652.660532:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790946652.660695:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790946652.660701:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1790946652.660706:0:8:0:(import.c:65:import_set_state_nolock()) ffff9146851e9000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790946652.660711:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 432 00000100:00080000:2.0:1790946652.660716:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1790946652.660726:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9146851e9000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:2.0:1790946652.660763:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9146b5a6ad80 x1877943303372544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790946652.660932:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5a6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1877943303372544:0@lo:8:kworker.0 00000100:00100000:2.0:1790946652.660969:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5a68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877943303372672:0@lo:400:kworker.0 00000100:00100000:2.0:1790946652.661016:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946652.661049:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790946652.661055:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5a69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1877943303372800:0@lo:400:kworker.0 00000100:00100000:2.0:1790946652.661078:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946652.664043:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5a6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303372928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790946652.664123:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946652.664169:0:15172:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303372928 00000100:00100000:3.0:1790946652.664179:0:15172:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303372928 00000100:00100000:3.0:1790946652.664263:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790946652.664274:0:15172:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914698015880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1877943303372928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790946652.664323:0:15172:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790946652.664374:0:15172:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914698015880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1877943303372928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946652.664382:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1790946652.664407:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790946652.664454:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5a6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303372928:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790946652.665099:0:14486:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303372672 00000100:00100000:2.0:1790946652.665106:0:14486:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303372672 00000100:00100000:2.0:1790946652.665135:0:14486:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303372800 00000100:00100000:2.0:1790946652.665138:0:14486:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303372800 00000100:00100000:2.0:1790946652.665158:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790946652.665165:0:14486:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5a69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877943303372672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946652.665243:0:14486:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5a69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877943303372672:12345-0@lo:400:kworker.0 Request processed in 78us (4226us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946652.665249:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790946652.665262:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790946652.665267:0:14486:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5a6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877943303372800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946652.665292:0:14486:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5a6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877943303372800:12345-0@lo:400:kworker.0 Request processed in 25us (4214us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946652.665297:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790946652.665342:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790946652.665455:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790946652.670688:0:15170:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303372416 00000100:00100000:1.0:1790946652.670710:0:15170:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303372416 00000100:00100000:1.0:1790946652.670784:0:15170:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303372544 00000100:00100000:1.0:1790946652.670787:0:15170:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303372544 00000100:00100000:1.0:1790946652.670806:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790946652.670816:0:15170:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914698017b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3300:x1877943303372416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946652.670949:0:15170:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914698017b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3300:x1877943303372416:12345-0@lo:400:kworker.0 Request processed in 134us (10415us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946652.670956:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790946652.670976:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790946652.670980:0:15170:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5a6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3299:x1877943303372544:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1790946652.671001:0:15170:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:2.0:1790946652.675235:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9146b5a69c00 x1877943303372800/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946652.675258:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5a69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1877943303372800:0@lo:400:kworker.0 00010000:00080000:2.0:1790946652.675274:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9146b5a68700 x1877943303372672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790946652.675283:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5a68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877943303372672:0@lo:400:kworker.0 00000100:00100000:0.0:1790946652.686037:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5a6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303372416:0@lo:400:kworker.0 00000100:00100000:1.0:1790946652.723093:0:15170:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5a6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3299:x1877943303372544:12345-0@lo:8:kworker.0 Request processed in 52097us (57736us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790946652.723112:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1790946652.723185:0:3299:0:(import.c:65:import_set_state_nolock()) ffff9146851e9000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790946652.723192:0:3299:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1790946652.723197:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5a6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1877943303372544:0@lo:8:kworker.0 00000001:00080000:3.0:1790946652.747548:0:6700:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:0.0:1790946653.360416:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1790946654.143327:0:15886:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1790946654.143333:0:15886:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1790946654.143467:0:15886:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9146a0073000 00000020:01000004:0.0:1790946654.143489:0:15886:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1790946654.143519:0:15886:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1790946654.143555:0:15886:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff914585d1b380) 00000020:00000080:0.0:1790946654.143578:0:15886:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1790946654.158369:0:15886:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1790946654.158678:0:15886:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1790946654.159541:0:15886:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1790946654.159779:0:15886:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1790946654.160426:0:15886:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1790946654.160791:0:15886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 337: rc = 0 00100000:10000000:0.0:1790946654.160887:0:15886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 337: rc = 0 00100000:10000000:0.0:1790946654.161062:0:15886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 337: rc = 0 00100000:10000000:0.0:1790946654.161576:0:15886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 451: rc = 0 00100000:10000000:0.0:1790946654.161821:0:15886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 451: rc = 0 00100000:10000000:0.0:1790946654.162180:0:15886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 451: rc = 0 00100000:10000000:0.0:1790946654.162501:0:15886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 451: rc = 0 00100000:10000000:0.0:1790946654.162728:0:15886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 451: rc = 0 00100000:10000000:0.0:1790946654.163058:0:15886:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 451: rc = 0 00000020:00000080:0.0:1790946654.163751:0:15886:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1790946654.163768:0:15886:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1790946654.163781:0:15886:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x16e41aef93272ef0 00000020:01000004:0.0:1790946654.163791:0:15886:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1790946654.163819:0:15886:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.113@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1790946654.163823:0:15886:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.113@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1790946654.163831:0:15886:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1790946654.163860:0:15886:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1790946654.163865:0:15886:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.113@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1790946654.172426:0:15886:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.113@tcp ctxt 0 is initialized 00000020:01000004:1.0:1790946654.172477:0:15886:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.113@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1790946654.172482:0:15886:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1790946654.172485:0:15886:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1790946654.172490:0:15886:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790946654.172491:0:15886:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790946654.172492:0:15886:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790946654.172494:0:15886:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790946654.172495:0:15886:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790946654.172497:0:15886:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790946654.172498:0:15886:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790946654.172503:0:15886:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1790946654.172505:0:15886:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790946654.172506:0:15886:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1790946654.172507:0:15886:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790946654.172508:0:15886:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790946654.172509:0:15886:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790946654.172510:0:15886:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790946654.172511:0:15886:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790946654.172512:0:15886:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790946654.172513:0:15886:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1790946654.172559:0:15886:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1790946654.172586:0:15886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91468e93fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15886:1877943303373056:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1790946654.172724:0:15886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946654.172829:0:15886:0:(client.c:2716:ptlrpc_set_wait()) set ffff914690149a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790946654.172881:0:14481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303373056 00000100:00100000:2.0:1790946654.172898:0:14481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303373056 00000100:00100000:2.0:1790946654.173005:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790946654.173015:0:14481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bc850850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+16:15886:x1877943303373056:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1790946654.173058:0:14481:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1790946654.173062:0:14481:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1790946654.173067:0:14481:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1790946654.180744:0:14481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bc850850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+16:15886:x1877943303373056:12345-0@lo:253:mount.lustre.0 Request processed in 7653us (7942us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946654.180764:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790946654.180891:0:15886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91468e93fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15886:1877943303373056:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790946654.184363:0:15886:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1790946654.184374:0:15886:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790946654.184376:0:15886:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790946654.184378:0:15886:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790946654.184379:0:15886:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790946654.184380:0:15886:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790946654.184382:0:15886:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790946654.184383:0:15886:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790946654.184386:0:15886:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790946654.184387:0:15886:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1790946654.184426:0:15886:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9146a0073000 from lustre-OST0001 10000000:01000000:2.0:1790946654.184473:0:15886:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1790946654.184477:0:15886:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1790946654.184489:0:15886:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9146849dcd40 local copy 00010000:00010000:2.0:1790946654.184506:0:15886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff914688aef000/0x16e41aef93272c96 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93272c9d expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946654.184846:0:15886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5a68700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15886:1877943303373184:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790946654.184946:0:15886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946654.184994:0:15886:0:(client.c:2716:ptlrpc_set_wait()) set ffff914698bb1480 going to sleep for 11 seconds 00000100:00100000:1.0:1790946654.185157:0:14480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303373184 00000100:00100000:1.0:1790946654.185167:0:14480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303373184 00000100:00100000:1.0:1790946654.185255:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1790946654.185266:0:14480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bc852850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+16:15886:x1877943303373184:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790946654.185481:0:14480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bc852850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+16:15886:x1877943303373184:12345-0@lo:501:mount.lustre.0 Request processed in 216us (535us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790946654.185490:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790946654.185711:0:15886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5a68700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15886:1877943303373184:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1790946654.185729:0:15886:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.113@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1790946654.185856:0:15886:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.113@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1790946654.185871:0:15886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff914688aef000/0x16e41aef93272c96 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93272c9d expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946654.185883:0:15886:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff914688aef000/0x16e41aef93272c96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93272c9d expref: -99 pid: 14468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790946654.185923:0:15886:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9146a0073000 10000000:01000000:2.0:1790946654.185929:0:15886:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1790946654.185936:0:15886:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1790946654.185938:0:15886:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790946654.185943:0:15886:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1790946654.185947:0:15886:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1790946654.185976:0:15886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff914688aef600/0x16e41aef93272ef7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946654.185984:0:15886:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff914688aef600/0x16e41aef93272ef7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946654.185994:0:15886:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff914688aef600/0x16e41aef93272ef7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946654.186008:0:15886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5a68700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15886:1877943303373312:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790946654.186039:0:15886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946654.186060:0:15886:0:(client.c:2716:ptlrpc_set_wait()) set ffff914698bb1480 going to sleep for 11 seconds 00000100:00100000:1.0:1790946654.186121:0:14481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303373312 00000100:00100000:1.0:1790946654.186127:0:14481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303373312 00000100:00100000:1.0:1790946654.186169:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790946654.186175:0:14481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bc852050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+16:15886:x1877943303373312:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790946654.186186:0:14481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946654.186227:0:14481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff914680030e00/0x16e41aef93272efe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x16e41aef93272ef7 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946654.186254:0:14481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff914680030e00/0x16e41aef93272efe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x16e41aef93272ef7 expref: 17 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946654.186264:0:14481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff914680030e00/0x16e41aef93272efe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93272ef7 expref: 17 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946654.186273:0:14481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914680030e00, rc 0) 00000100:00100000:1.0:1790946654.186307:0:14481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bc852050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+17:15886:x1877943303373312:12345-0@lo:101:mount.lustre.0 Request processed in 132us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946654.186313:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1790946654.186402:0:15886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5a68700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15886:1877943303373312:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790946654.186415:0:15886:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff914688aef600/0x16e41aef93272ef7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93272efe expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946654.186425:0:15886:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff914688aef600/0x16e41aef93272ef7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93272efe expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790946654.187345:0:15886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1790946654.188745:0:15886:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790946654.189081:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1790946654.189131:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1790946654.189168:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1790946654.189258:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1790946654.189298:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1790946654.189333:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1790946654.189401:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1790946654.189410:0:15886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1790946654.190359:0:15886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91468e93ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15886:1877943303373440:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790946654.190456:0:15886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946654.190549:0:15886:0:(client.c:2716:ptlrpc_set_wait()) set ffff914690149900 going to sleep for 11 seconds 00000100:00100000:0.0:1790946654.190657:0:14478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303373440 00000100:00100000:0.0:1790946654.190737:0:14478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303373440 00000100:00100000:0.0:1790946654.190833:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1790946654.190845:0:14478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5804850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+17:15886:x1877943303373440:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790946654.191496:0:14478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5804850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+17:15886:x1877943303373440:12345-0@lo:501:mount.lustre.0 Request processed in 651us (1038us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946654.191506:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790946654.191630:0:15886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91468e93ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15886:1877943303373440:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790946654.191698:0:15886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5a69c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15886:1877943303373568:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790946654.191750:0:15886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946654.192108:0:15886:0:(client.c:2716:ptlrpc_set_wait()) set ffff914698bb16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790946654.192184:0:14481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303373568 00000100:00100000:1.0:1790946654.192192:0:14481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303373568 00000100:00100000:1.0:1790946654.192253:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1790946654.192262:0:14481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5806c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+17:15886:x1877943303373568:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790946654.192746:0:14481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5806c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+17:15886:x1877943303373568:12345-0@lo:503:mount.lustre.0 Request processed in 483us (993us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946654.192754:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790946654.192872:0:15886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5a69c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15886:1877943303373568:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790946654.193871:0:15886:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790946654.194956:0:15886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5a69c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15886:1877943303373696:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790946654.195064:0:15886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946654.195116:0:15886:0:(client.c:2716:ptlrpc_set_wait()) set ffff914698bb16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790946654.195377:0:14481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303373696 00000100:00100000:3.0:1790946654.195386:0:14481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303373696 00000100:00100000:3.0:1790946654.195436:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1790946654.195444:0:14481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+17:15886:x1877943303373696:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790946654.195927:0:14481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+17:15886:x1877943303373696:12345-0@lo:502:mount.lustre.0 Request processed in 482us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946654.195935:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790946654.196049:0:15886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5a69c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15886:1877943303373696:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790946654.197530:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1790946654.197737:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1790946654.197775:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1790946654.197862:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1790946654.197908:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1790946654.197945:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1790946654.197994:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1790946654.198030:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1790946654.198081:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1790946654.198136:0:15886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5a69c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15886:1877943303373824:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790946654.198381:0:15886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946654.198483:0:15886:0:(client.c:2716:ptlrpc_set_wait()) set ffff914698bb16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790946654.198546:0:14480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303373824 00000100:00100000:3.0:1790946654.198561:0:14480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303373824 00000100:00100000:3.0:1790946654.198768:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1790946654.198779:0:14480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5807050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+17:15886:x1877943303373824:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790946654.199025:0:14480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5807050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+17:15886:x1877943303373824:12345-0@lo:502:mount.lustre.0 Request processed in 248us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946654.199034:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790946654.199117:0:15886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5a69c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15886:1877943303373824:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790946654.199192:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1790946654.199235:0:15886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1790946654.202608:0:15888:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790946654.202625:0:15888:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1790946654.202634:0:15888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790946654.202637:0:15888:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1790946654.202647:0:15888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790946654.202676:0:15888:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9146c1ca0000) 00000020:00000080:1.0:1790946654.202708:0:15888:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1790946654.202715:0:15888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1790946654.202791:0:15888:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9146a0073000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1790946654.202801:0:15888:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1790946654.202809:0:15888:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x16e41aef93272f0c 00010000:00010000:1.0:1790946654.210932:0:15888:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1790946654.216048:0:15888:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:1.0:1790946654.219280:0:15888:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1790946654.225345:0:15888:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1790946654.225364:0:15888:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790946654.225372:0:15888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946654.225375:0:15888:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1790946654.225379:0:15888:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790946654.225384:0:15888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946654.225386:0:15888:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790946654.225389:0:15888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790946654.225405:0:15888:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1790946654.225409:0:15888:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790946654.225412:0:15888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946654.225413:0:15888:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:2.0:1790946654.225416:0:15888:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790946654.225419:0:15888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946654.225420:0:15888:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1790946654.225424:0:15888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1790946654.225503:0:15888:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790946654.225506:0:15888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790946654.225508:0:15888:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1790946654.225511:0:15888:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1790946654.225892:0:15886:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1790946654.225937:0:15886:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1790946654.225970:0:15886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff914688aef600/0x16e41aef93272ef7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93272efe expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946654.225985:0:15886:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff914688aef600/0x16e41aef93272ef7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93272efe expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790946654.225995:0:15886:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9146a0073000 from 1 10000000:01000000:1.0:1790946654.225999:0:15886:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790946654.226043:0:15886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff914680031c00/0x16e41aef93272f13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946654.226063:0:15886:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff914680031c00/0x16e41aef93272f13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946654.226077:0:15886:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff914680031c00/0x16e41aef93272f13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946654.226104:0:15886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91468e93d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15886:1877943303373952:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790946654.226194:0:15886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946654.226928:0:15886:0:(client.c:2716:ptlrpc_set_wait()) set ffff914690149d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790946654.229650:0:14481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303373952 00000100:00100000:0.0:1790946654.229714:0:14481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303373952 00000100:00100000:0.0:1790946654.229835:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1790946654.229849:0:14481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5807450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+17:15886:x1877943303373952:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790946654.229872:0:14481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946654.229894:0:14481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9146b1933200/0x16e41aef93272f1a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x16e41aef93272f13 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946654.229936:0:14481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9146b1933200/0x16e41aef93272f1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x16e41aef93272f13 expref: 18 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946654.229948:0:14481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9146b1933200/0x16e41aef93272f1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93272f13 expref: 18 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946654.229958:0:14481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b1933200, rc 0) 00000100:00100000:0.0:1790946654.230058:0:14481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5807450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+18:15886:x1877943303373952:12345-0@lo:101:mount.lustre.0 Request processed in 212us (3864us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946654.230066:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790946654.230166:0:15886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91468e93d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15886:1877943303373952:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790946654.230190:0:15886:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff914680031c00/0x16e41aef93272f13 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93272f1a expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946654.230221:0:15886:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff914680031c00/0x16e41aef93272f13 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93272f1a expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790946654.230869:0:15886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1790946654.231437:0:15886:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790946654.231684:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1790946654.231734:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1790946654.231799:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1790946654.231809:0:15886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1790946654.231918:0:15886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914698016d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15886:1877943303374080:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790946654.231991:0:15886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946654.236894:0:15886:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146c1c9f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790946654.238752:0:14478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303374080 00000100:00100000:1.0:1790946654.238771:0:14478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303374080 00000100:00100000:1.0:1790946654.238841:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790946654.238853:0:14478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5806850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+18:15886:x1877943303374080:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790946654.239428:0:14478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5806850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+18:15886:x1877943303374080:12345-0@lo:501:mount.lustre.0 Request processed in 575us (7434us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946654.239437:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790946654.239612:0:15886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914698016d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15886:1877943303374080:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790946654.241999:0:15886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914698016d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15886:1877943303374208:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790946654.242130:0:15886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946654.242183:0:15886:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146c1c9f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790946654.244963:0:14481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303374208 00000100:00100000:0.0:1790946654.245002:0:14481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303374208 00000100:00100000:0.0:1790946654.245220:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790946654.245232:0:14481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5804050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+18:15886:x1877943303374208:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790946654.245664:0:14481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5804050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+18:15886:x1877943303374208:12345-0@lo:503:mount.lustre.0 Request processed in 434us (3534us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946654.245674:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790946654.246866:0:15886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914698016d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15886:1877943303374208:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1790946654.252989:0:15886:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790946654.253985:0:15886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914698016d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15886:1877943303374336:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790946654.254098:0:15886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946654.254146:0:15886:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146c1c9f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790946654.254450:0:14481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303374336 00000100:00100000:0.0:1790946654.254459:0:14481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303374336 00000100:00100000:0.0:1790946654.254509:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790946654.254520:0:14481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5805050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+18:15886:x1877943303374336:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790946654.254940:0:14481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5805050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+18:15886:x1877943303374336:12345-0@lo:502:mount.lustre.0 Request processed in 421us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946654.254949:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790946654.256150:0:15886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914698016d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15886:1877943303374336:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790946654.256503:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1790946654.257409:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1790946654.257485:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1790946654.257530:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1790946654.257968:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1790946654.258031:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1790946654.258069:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1790946654.258100:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1790946654.258153:0:15886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914698016d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15886:1877943303374464:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790946654.259413:0:15886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946654.259471:0:15886:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146c1c9f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790946654.259712:0:14480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303374464 00000100:00100000:2.0:1790946654.259723:0:14480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303374464 00000100:00100000:2.0:1790946654.259916:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790946654.259927:0:14480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+18:15886:x1877943303374464:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790946654.261779:0:14480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+18:15886:x1877943303374464:12345-0@lo:502:mount.lustre.0 Request processed in 1842us (2362us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946654.261795:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1790946654.264030:0:15886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914698016d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15886:1877943303374464:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790946654.264825:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1790946654.264846:0:15886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1790946654.268607:0:15892:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790946654.268764:0:15892:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790946654.268767:0:15892:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1790946654.268778:0:15892:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9146a0073000 00000020:00000080:1.0:1790946654.268781:0:15892:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790946654.268790:0:15892:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790946654.268793:0:15892:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790946654.268794:0:15892:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1790946654.268797:0:15892:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790946654.268800:0:15892:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790946654.268801:0:15892:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1790946654.268804:0:15892:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9146a0073000 00000020:00000080:1.0:1790946654.268818:0:15892:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790946654.269029:0:15892:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790946654.269033:0:15892:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790946654.269035:0:15892:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1790946654.269038:0:15892:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790946654.269041:0:15892:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790946654.269042:0:15892:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790946654.269045:0:15892:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9146a0073000 00000020:00000080:1.0:1790946654.269047:0:15892:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790946654.274430:0:15892:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790946654.274449:0:15892:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790946654.274452:0:15892:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1790946654.274459:0:15892:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1790946654.278436:0:15886:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1790946654.278490:0:15886:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790946654.278646:0:15886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff914680031c00/0x16e41aef93272f13 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93272f1a expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946654.278662:0:15886:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff914680031c00/0x16e41aef93272f13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93272f1a expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790946654.278737:0:15886:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1790946654.278749:0:15886:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9146a0073000 10000000:01000000:3.0:1790946654.278753:0:15886:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9146a0073000 10000000:01000000:3.0:1790946654.278758:0:15886:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790946654.278767:0:15886:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9146a0073000 from 1 10000000:01000000:3.0:1790946654.278770:0:15886:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790946654.278818:0:15886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146be9f7600/0x16e41aef93272f21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946654.278829:0:15886:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9146be9f7600/0x16e41aef93272f21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946654.279360:0:15886:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9146be9f7600/0x16e41aef93272f21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946654.279627:0:15886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914698016d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15886:1877943303374592:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790946654.280894:0:15886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946654.281098:0:14481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303374592 00000100:00100000:1.0:1790946654.281111:0:14481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303374592 00000100:00100000:1.0:1790946654.281177:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790946654.281188:0:14481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+18:15886:x1877943303374592:12345-0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790946654.281347:0:15886:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146c1c9ff00 going to sleep for 11 seconds 00010000:00010000:1.0:1790946654.281582:0:14481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946654.281695:0:14481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff914680030800/0x16e41aef93272f28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x16e41aef93272f21 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946654.281834:0:14481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff914680030800/0x16e41aef93272f28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x16e41aef93272f21 expref: 19 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946654.281849:0:14481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff914680030800/0x16e41aef93272f28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93272f21 expref: 19 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946654.281859:0:14481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914680030800, rc 0) 00000100:00100000:1.0:1790946654.282122:0:14481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+19:15886:x1877943303374592:12345-0@lo:101:mount.lustre.0 Request processed in 935us (1233us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946654.282130:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790946654.282489:0:15886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914698016d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15886:1877943303374592:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790946654.282512:0:15886:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9146be9f7600/0x16e41aef93272f21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93272f28 expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946654.282522:0:15886:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9146be9f7600/0x16e41aef93272f21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93272f28 expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790946654.288265:0:15886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1790946654.288992:0:15886:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790946654.289306:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1790946654.289351:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1790946654.289386:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1790946654.289454:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1790946654.289500:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1790946654.289547:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1790946654.289582:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1790946654.289616:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1790946654.289660:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1790946654.292243:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1790946654.292289:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1790946654.292372:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1790946654.292412:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1790946654.292448:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1790946654.292497:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1790946654.292533:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1790946654.292569:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1790946654.292618:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1790946654.292655:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1790946654.292700:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1790946654.292747:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1790946654.292780:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1790946654.292815:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1790946654.292864:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1790946654.296120:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1790946654.296169:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1790946654.296286:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1790946654.296327:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1790946654.296363:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1790946654.296413:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:3.0:1790946654.296448:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:3.0:1790946654.296481:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:3.0:1790946654.296513:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:3.0:1790946654.296559:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:3.0:1790946654.296597:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:3.0:1790946654.296647:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:3.0:1790946654.296683:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:3.0:1790946654.296806:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:3.0:1790946654.296815:0:15886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1790946654.300292:0:15886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914698016d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15886:1877943303374720:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790946654.300389:0:15886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946654.300497:0:15886:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146c1c9ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1790946654.309456:0:14480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303374720 00000100:00100000:0.0:1790946654.309481:0:14480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303374720 00000100:00100000:0.0:1790946654.309618:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790946654.309630:0:14480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+19:15886:x1877943303374720:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790946654.310978:0:14480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+19:15886:x1877943303374720:12345-0@lo:501:mount.lustre.0 Request processed in 1341us (10580us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946654.310993:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1790946654.316283:0:15886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914698016d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15886:1877943303374720:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790946654.316363:0:15886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914698016d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15886:1877943303374848:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790946654.316459:0:15886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946654.316507:0:14481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303374848 00000100:00100000:3.0:1790946654.316516:0:14481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303374848 00000100:00100000:3.0:1790946654.316571:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790946654.316581:0:14481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+19:15886:x1877943303374848:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790946654.316928:0:14481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+19:15886:x1877943303374848:12345-0@lo:503:mount.lustre.0 Request processed in 348us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946654.316937:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790946654.316999:0:15886:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146c1c9ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1790946654.317014:0:15886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914698016d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15886:1877943303374848:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1790946654.317687:0:15886:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790946654.317770:0:15886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914698016d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15886:1877943303374976:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790946654.317816:0:15886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946654.317848:0:14481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303374976 00000100:00100000:3.0:1790946654.317854:0:14481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303374976 00000100:00100000:3.0:1790946654.317884:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1790946654.317891:0:14481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+19:15886:x1877943303374976:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790946654.318162:0:14481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+19:15886:x1877943303374976:12345-0@lo:502:mount.lustre.0 Request processed in 271us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946654.318175:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1790946654.318258:0:15886:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146c1c9ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1790946654.318275:0:15886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914698016d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15886:1877943303374976:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790946654.318526:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1790946654.318576:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1790946654.318611:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1790946654.318679:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1790946654.318719:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1790946654.318767:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1790946654.318801:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1790946654.318831:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1790946654.318927:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1790946654.318970:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1790946654.319006:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1790946654.319055:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1790946654.319095:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1790946654.319132:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1790946654.319176:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1790946654.319245:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1790946654.319283:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1790946654.319334:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1790946654.319372:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1790946654.319422:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1790946654.319469:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1790946654.319505:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1790946654.319542:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1790946654.319594:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1790946654.319634:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1790946654.337748:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1790946654.337948:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1790946654.337986:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1790946654.338017:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1790946654.338064:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1790946654.338098:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1790946654.338131:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1790946654.338165:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1790946654.338266:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1790946654.338303:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1790946654.338353:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1790946654.338388:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1790946654.338423:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1790946654.338483:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1790946654.338519:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1790946654.338675:0:15886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5a69c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15886:1877943303375104:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790946654.338784:0:15886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946654.338836:0:15886:0:(client.c:2716:ptlrpc_set_wait()) set ffff914698bb1d80 going to sleep for 11 seconds 00000100:00100000:3.0:1790946654.341015:0:14481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303375104 00000100:00100000:3.0:1790946654.341034:0:14481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303375104 00000100:00100000:3.0:1790946654.341184:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790946654.341195:0:14481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bee12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+19:15886:x1877943303375104:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790946654.341838:0:14481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bee12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+19:15886:x1877943303375104:12345-0@lo:502:mount.lustre.0 Request processed in 644us (3054us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946654.341846:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1790946654.342010:0:15886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5a69c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15886:1877943303375104:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790946654.342143:0:15886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1790946654.342161:0:15886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1790946654.343676:0:15897:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1790946654.343697:0:15897:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff914585d18000) 00000020:00000080:0.0:1790946654.343725:0:15897:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:0.0:1790946654.343832:0:15897:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9146a0073000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1790946654.343836:0:15897:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9146a0073000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1790946654.343839:0:15897:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9146a0073000 3 00010000:00080000:0.0:1790946654.343885:0:15897:0:(ldlm_lib.c:102:import_set_conn()) imp ffff914684886800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.113@tcp at head 00010000:00010000:2.0:1790946654.347992:0:15897:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1790946654.349639:0:15897:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1790946654.349710:0:15897:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790946654.349731:0:15897:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x16e41aef93272f36 00000100:00080000:2.0:1790946654.349745:0:15897:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790946654.349759:0:15897:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff914684886800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:2.0:1790946654.349809:0:15897:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9146b5a68e00 x1877943303375232/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790946654.350679:0:15897:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1790946654.350735:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5a68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1877943303375232:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790946654.350840:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946654.350939:0:14486:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303375232 00000100:00100000:3.0:1790946654.350948:0:14486:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303375232 00000100:00100000:3.0:1790946654.350985:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790946654.350993:0:14486:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914698016d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1877943303375232:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1790946654.351026:0:14486:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 439 last 0 00000020:00000080:3.0:1790946654.351072:0:14486:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x16e41aef93272f3d 00000004:00100000:3.0:1790946654.351092:0:14486:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1790946654.351137:0:14486:0:(import.c:65:import_set_state_nolock()) ffff9146a1999800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790946654.351197:0:14486:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914698016d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1877943303375232:12345-0@lo:38:llog_process_th.0 Request processed in 203us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946654.351225:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1790946654.351285:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9146b5a68e00 x1877943303375232/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790946664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946654.351297:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790946654.351305:0:3299:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1790946654.351314:0:3299:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1790946654.351318:0:3299:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1790946654.351321:0:3299:0:(import.c:65:import_set_state_nolock()) ffff914684886800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1790946654.351328:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5a68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1877943303375232:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790946654.354482:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be98ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303375360:0@lo:400:kworker.0 00000100:00100000:2.0:1790946654.354633:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1790946654.354701:0:14039:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790946654.354707:0:14039:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1790946654.354712:0:14039:0:(import.c:65:import_set_state_nolock()) ffff9146851e9000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790946654.354717:0:14039:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 437 00000100:00080000:0.0:1790946654.354722:0:14039:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1790946654.354733:0:14039:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9146851e9000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:0.0:1790946654.354760:0:14039:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9146be98e680 x1877943303375488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790946654.354831:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be98e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1877943303375488:0@lo:8:kworker.0 00000100:00100000:0.0:1790946654.354863:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946654.354908:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be98e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877943303375616:0@lo:400:kworker.0 00000100:00100000:0.0:1790946654.354936:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946654.354971:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790946654.354976:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be98ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1877943303375744:0@lo:400:kworker.0 00000100:00100000:0.0:1790946654.354997:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946654.355038:0:15171:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303375360 00000100:00100000:0.0:1790946654.355048:0:15171:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303375360 00000100:00100000:0.0:1790946654.355110:0:15171:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303375488 00000100:00100000:0.0:1790946654.355113:0:15171:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303375488 00000100:00100000:0.0:1790946654.355125:0:15171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790946654.355134:0:15171:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5a69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1877943303375360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946654.356720:0:15171:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5a69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1877943303375360:12345-0@lo:400:kworker.0 Request processed in 1574us (2075us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946654.356764:0:15171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790946654.356806:0:15171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790946654.356813:0:15171:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be98d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3299:x1877943303375488:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1790946654.356921:0:15171:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be98d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3299:x1877943303375488:12345-0@lo:8:kworker.0 Request processed in 106us (2056us total) trans 0 rc -11/-11 00000100:00100000:0.0:1790946654.356928:0:15171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790946654.356963:0:14488:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303375616 00000100:00100000:0.0:1790946654.356973:0:14488:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303375616 00000100:00100000:0.0:1790946654.357017:0:14488:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303375744 00000100:00100000:0.0:1790946654.357021:0:14488:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303375744 00000100:00100000:0.0:1790946654.357045:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790946654.357051:0:14488:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be98ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877943303375616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946654.357101:0:14488:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be98ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877943303375616:12345-0@lo:400:kworker.0 Request processed in 50us (2163us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946654.357108:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790946654.357263:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790946654.357272:0:14488:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be98f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877943303375744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946654.357663:0:14488:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be98f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1877943303375744:12345-0@lo:400:kworker.0 Request processed in 392us (2664us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946654.357670:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1790946654.357698:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790946654.357704:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790946654.357839:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790946654.357850:0:3299:0:(import.c:65:import_set_state_nolock()) ffff9146851e9000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790946654.357854:0:3299:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1790946654.357859:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be98e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1877943303375488:0@lo:8:kworker.0 00010000:00080000:0.0:1790946654.357933:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9146be98ce00 x1877943303375744/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946670 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946654.357946:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be98ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1877943303375744:0@lo:400:kworker.0 00010000:00080000:0.0:1790946654.357957:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9146be98e300 x1877943303375616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946670 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946654.357965:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be98e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877943303375616:0@lo:400:kworker.0 00000100:00100000:2.0:1790946654.358078:0:3301:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1790946654.358094:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be98ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303375360:0@lo:400:kworker.0 00000040:00080000:2.0:1790946654.358721:0:15897:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1790946654.359833:0:15886:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1790946654.360032:0:15886:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790946654.360499:0:15886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9146be9f7600/0x16e41aef93272f21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93272f28 expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946654.360513:0:15886:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9146be9f7600/0x16e41aef93272f21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93272f28 expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1790946654.361308:0:15886:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1790946654.361310:0:15886:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790946654.361312:0:15886:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790946654.361313:0:15886:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790946654.361315:0:15886:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790946654.361317:0:15886:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790946654.361318:0:15886:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790946654.361321:0:15886:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790946654.361322:0:15886:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790946654.361326:0:15886:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1790946654.361329:0:15886:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790946654.361330:0:15886:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790946654.361331:0:15886:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790946654.361333:0:15886:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790946654.361334:0:15886:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790946654.361335:0:15886:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790946654.361336:0:15886:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790946654.361337:0:15886:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790946654.361338:0:15886:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790946654.361371:0:15886:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1790946654.361399:0:15886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5a6b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15886:1877943303375872:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790946654.361511:0:15886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946654.361579:0:15886:0:(client.c:2716:ptlrpc_set_wait()) set ffff914698bb1d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790946654.361796:0:14480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303375872 00000100:00100000:0.0:1790946654.361808:0:14480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303375872 00000100:00100000:0.0:1790946654.361919:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1790946654.361930:0:14480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468872b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+19:15886:x1877943303375872:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790946654.361965:0:14480:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1790946654.361984:0:14480:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:1.0:1790946654.384834:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:1.0:1790946654.409530:0:14480:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1790946654.409552:0:14480:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1790946654.410242:0:14502:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1790946654.410248:0:14502:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1790946654.410271:0:14502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9146be9f6a00/0x16e41aef93272f44 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946654.410291:0:14502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9146b180ea00/0x16e41aef93272e17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93272e10 expref: 19 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946654.410299:0:14502:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9146be9f6a00/0x16e41aef93272f44 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946654.410342:0:14502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9146b180ea00/0x16e41aef93272e17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x16e41aef93272e10 expref: 19 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946654.410362:0:14502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9146b180ea00/0x16e41aef93272e17 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x16e41aef93272e10 expref: 19 pid: 14480 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946654.410376:0:14502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914698015f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14502:1877943303376000:0@lo:104: 00000100:00100000:3.0:1790946654.410446:0:14502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946654.410486:0:14502:0:(client.c:2716:ptlrpc_set_wait()) set ffff914684872600 going to sleep for 11 seconds 00000100:00100000:1.0:1790946654.410928:0:14469:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303376000 00000100:00100000:1.0:1790946654.410938:0:14469:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303376000 00000100:00100000:1.0:1790946654.410991:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790946654.411002:0:14469:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914698014700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+3:14502:x1877943303376000:12345-0@lo:104: 00010000:00010000:1.0:1790946654.411016:0:14469:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9146be9f7800/0x16e41aef93272e10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93272e17 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946654.411094:0:14469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790946654.411103:0:14469:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914698014700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+3:14502:x1877943303376000:12345-0@lo:104: Request processed in 101us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946654.411112:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790946654.411447:0:14502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914698015f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14502:1877943303376000:0@lo:104: 00010000:00010000:2.0:1790946654.411571:0:14502:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9146be9f6a00/0x16e41aef93272f44 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946654.412833:0:14474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790946654.412845:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9146be9f7800/0x16e41aef93272e10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93272e17 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946654.412856:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146be9f7800 already unused, calling callback (ffffffffc1d96c20) 10000000:00010000:0.0:1790946654.412860:0:14474:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9146be9f7800/0x16e41aef93272e10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x16e41aef93272e17 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946654.412868:0:14474:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9146be9f7800/0x16e41aef93272e10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x16e41aef93272e17 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790946654.412875:0:14474:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9146be9f7800/0x16e41aef93272e10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x16e41aef93272e17 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790946654.412880:0:14474:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790946654.412951:0:14474:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9146be9f7800/0x16e41aef93272e10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93272e17 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946654.412958:0:14474:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790946654.412997:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9146be9f7800/0x16e41aef93272e10 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93272e17 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946654.413005:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9146be9f7800/0x16e41aef93272e10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93272e17 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946654.413009:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1790946654.413027:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946654.413031:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946654.413034:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946654.413108:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be98e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:3301:1877943303376128:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790946654.413252:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946654.414290:0:14471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303376128 00000100:00100000:0.0:1790946654.414301:0:14471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303376128 00010000:00010000:0.0:1790946654.414339:0:14471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9146b180ea00/0x16e41aef93272e17 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef93272e10 expref: 20 pid: 14480 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946654.414382:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790946654.414391:0:14471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5a68a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+20:3301:x1877943303376128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790946654.414403:0:14471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790946654.414408:0:14471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9146b180ea00/0x16e41aef93272e17 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef93272e10 expref: 20 pid: 14480 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946654.414419:0:14471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9146b180ea00/0x16e41aef93272e17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x16e41aef93272e10 expref: 20 pid: 14480 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946654.414435:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9146b180ea00/0x16e41aef93272e17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x16e41aef93272e10 expref: 20 pid: 14480 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946654.414451:0:14471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9146be9f6a00/0x16e41aef93272f44 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946654.414469:0:14471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9146be9f6a00/0x16e41aef93272f44 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790946654.414486:0:14471:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004238968s 00010000:00010000:0.0:1790946654.414491:0:14471:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9146be9f6a00/0x16e41aef93272f44 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946654.414497:0:14471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9146be9f6a00/0x16e41aef93272f44 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946654.414504:0:14471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9146be9f6a00/0x16e41aef93272f44 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946654.414511:0:14471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9146be9f6a00/0x16e41aef93272f44 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946654.414517:0:14471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146be9f6a00 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:0.0:1790946654.414521:0:14471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9146be9f6a00/0x16e41aef93272f44 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946654.414528:0:14471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9146be9f6a00/0x16e41aef93272f44 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946654.414551:0:14471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9146be9f6a00/0x16e41aef93272f44 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946654.416453:0:14471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790946654.416549:0:14471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5a68a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+19:3301:x1877943303376128:12345-0@lo:103:ldlm_bl.0 Request processed in 2156us (3294us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946654.416571:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790946654.416918:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be98e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:3301:1877943303376128:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790946654.417003:0:14502:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9146be9f6a00/0x16e41aef93272f44 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946654.417016:0:14502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9146be9f6a00/0x16e41aef93272f44 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946654.417023:0:14502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9146be9f6a00/0x16e41aef93272f44 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946654.435157:0:14480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468872b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+18:15886:x1877943303375872:12345-0@lo:253:mount.lustre.0 Request processed in 73220us (73638us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946654.435173:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1790946654.435633:0:15886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5a6b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:15886:1877943303375872:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790946654.435662:0:15886:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1790946654.435666:0:15886:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790946654.435667:0:15886:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790946654.435669:0:15886:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790946654.435670:0:15886:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790946654.435672:0:15886:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790946654.435673:0:15886:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790946654.435674:0:15886:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790946654.435676:0:15886:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790946654.435678:0:15886:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1790946654.435694:0:15886:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1790946654.443091:0:15886:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1790946654.443861:0:15886:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1790946654.444033:0:15886:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1790946654.444732:0:15886:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1790946654.444889:0:15886:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1790946654.445328:0:15886:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1790946654.452195:0:15886:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1790946654.540989:0:15886:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1790946654.540997:0:15886:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1790946654.541032:0:15886:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1790946654.541100:0:15886:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.113@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1790946654.541243:0:15886:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1790946654.541375:0:15886:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000040:00080000:1.0:1790946654.960824:0:14517:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790946655.408828:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1790946656.242974:0:14483:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790946656.242982:0:14483:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff914586f39800 from 8 10000000:01000000:2.0:1790946656.242987:0:14483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790946656.243035:0:14483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff914688aef800/0x16e41aef93272f4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946656.243048:0:14483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff914688aef800/0x16e41aef93272f4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946656.243059:0:14483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff914688aef800/0x16e41aef93272f4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946656.243084:0:14483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5a6b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14483:1877943303376256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790946656.243153:0:14483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946656.243249:0:14483:0:(client.c:2716:ptlrpc_set_wait()) set ffff914690149b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790946656.243735:0:14481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303376256 00000100:00100000:3.0:1790946656.243744:0:14481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303376256 00000100:00100000:3.0:1790946656.243823:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790946656.243834:0:14481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914688728c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+18:14483:x1877943303376256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790946656.243849:0:14481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946656.243864:0:14481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9146be9f6a00/0x16e41aef93272f52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x16e41aef93272f4b expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946656.243897:0:14481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9146be9f6a00/0x16e41aef93272f52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x16e41aef93272f4b expref: 19 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946656.243909:0:14481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9146be9f6a00/0x16e41aef93272f52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93272f4b expref: 19 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946656.243918:0:14481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146be9f6a00, rc 0) 00000100:00100000:3.0:1790946656.243979:0:14481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914688728c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+19:14483:x1877943303376256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946656.243985:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1790946656.244012:0:14483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5a6b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14483:1877943303376256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790946656.244029:0:14483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff914688aef800/0x16e41aef93272f4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93272f52 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946656.244038:0:14483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff914688aef800/0x16e41aef93272f4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef93272f52 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946656.244091:0:14483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be98ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14483:1877943303376384:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1790946656.244126:0:14483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946656.244153:0:14483:0:(client.c:2716:ptlrpc_set_wait()) set ffff91468574fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790946656.244548:0:14480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303376384 00000100:00100000:1.0:1790946656.244554:0:14480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303376384 00000100:00100000:1.0:1790946656.244591:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1790946656.244598:0:14480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914688729850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+19:14483:x1877943303376384:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1790946656.244613:0:14480:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1790946656.244629:0:14480:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790946656.244633:0:14480:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1790946656.244722:0:14480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914688729850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+19:14483:x1877943303376384:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 124us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946656.244730:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1790946656.244905:0:14483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be98ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14483:1877943303376384:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1790946656.244973:0:14483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790946656.244981:0:14483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff914688aef800/0x16e41aef93272f4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93272f52 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946656.244989:0:14483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff914688aef800/0x16e41aef93272f4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef93272f52 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946656.441318:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946657.456712:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946657.778140:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790946657.778169:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5a69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303376512:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790946657.778264:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946657.778340:0:15172:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303376512 00000100:00100000:2.0:1790946657.778347:0:15172:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303376512 00000100:00100000:2.0:1790946657.778400:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790946657.778409:0:15172:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5a69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303376512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790946657.778444:0:15172:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790946657.778489:0:15172:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5a69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303376512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946657.778497:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1790946657.778518:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790946657.778567:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5a69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303376512:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790946658.481703:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946659.509788:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790946659.829989:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790946659.830006:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1790946659.830010:0:36:0:(import.c:65:import_set_state_nolock()) ffff9146851e9000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790946659.830026:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9146851e9000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:3.0:1790946659.830050:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff914698014000 x1877943303376896/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790946659.830117:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914698017100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:3302:1877943303376640:0@lo:400:kworker.0 00000100:00100000:3.0:1790946659.830184:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946659.830251:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914698015180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1877943303377280:0@lo:400:kworker.0 00000100:00100000:3.0:1790946659.830278:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946659.830313:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790946659.830320:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914698014380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303376768:0@lo:400:kworker.0 00000100:00100000:3.0:1790946659.830346:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946659.830375:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914698014000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1877943303376896:0@lo:8:kworker.0 00000100:00100000:3.0:1790946659.830397:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946659.830423:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914698017800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877943303377024:0@lo:400:kworker.0 00000100:00100000:3.0:1790946659.830451:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946659.830469:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790946659.830474:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914698016680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1877943303377152:0@lo:400:kworker.0 00000100:00100000:3.0:1790946659.830498:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946659.830530:0:14480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303376640 00000100:00100000:3.0:1790946659.830537:0:14480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303376640 00000100:00100000:3.0:1790946659.830579:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790946659.830587:0:14480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914688728450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+19:3302:x1877943303376640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946659.830632:0:14480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914688728450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+19:3302:x1877943303376640:12345-0@lo:400:kworker.0 Request processed in 46us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946659.830639:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790946659.830669:0:14488:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303377280 00000100:00100000:3.0:1790946659.830673:0:14488:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303377280 00000100:00100000:3.0:1790946659.830701:0:14488:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303377024 00000100:00100000:3.0:1790946659.830703:0:14488:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303377024 00000100:00100000:3.0:1790946659.830711:0:14488:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303377152 00000100:00100000:3.0:1790946659.830713:0:14488:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303377152 00000100:00100000:3.0:1790946659.830724:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790946659.830728:0:14488:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914698015f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877943303377280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946659.831389:0:14487:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1790946659.831406:0:14487:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1790946659.831421:0:14486:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1790946659.831429:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790946659.831436:0:14486:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914698014a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877943303377024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946659.831482:0:14486:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914698014a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877943303377024:12345-0@lo:400:kworker.0 Request processed in 46us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946659.831488:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790946659.831501:0:14486:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1790946659.831507:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790946659.831513:0:14486:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914698015500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1877943303377152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946659.831538:0:14486:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914698015500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1877943303377152:12345-0@lo:400:kworker.0 Request processed in 26us (1040us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946659.831545:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790946659.831562:0:15170:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303376768 00000100:00100000:0.0:1790946659.831567:0:15170:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303376768 00000100:00100000:0.0:1790946659.831600:0:15170:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303376896 00000100:00100000:0.0:1790946659.831603:0:15170:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303376896 00000100:00100000:0.0:1790946659.831614:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790946659.831620:0:15170:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914698016300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303376768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946659.831648:0:15170:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914698016300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303376768:12345-0@lo:400:kworker.0 Request processed in 28us (1301us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946659.831653:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790946659.831664:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790946659.831668:0:15170:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914698017480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3299:x1877943303376896:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1790946659.831691:0:15170:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 444 last 0 00000020:00000080:0.0:1790946659.831717:0:15170:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x16e41aef93272f59 00002000:00100000:0.0:1790946659.831729:0:15170:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9146b7862800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b03 ocd_grant: 0 ocd_index: 1 ocd_group 0 00000100:00100000:3.0:1790946659.832191:0:14488:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914698015f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877943303377280:12345-0@lo:400:kworker.0 Request processed in 1460us (1910us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946659.832211:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1790946659.832237:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790946659.832242:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1790946659.832347:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff914698016680 x1877943303377152/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946659.832361:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914698016680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1877943303377152:0@lo:400:kworker.0 00010000:00080000:3.0:1790946659.832374:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff914698017800 x1877943303377024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946659.832383:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914698017800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877943303377024:0@lo:400:kworker.0 00000100:00100000:3.0:1790946659.832415:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914698014380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303376768:0@lo:400:kworker.0 00000100:00100000:3.0:1790946659.832425:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914698017100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:3302:1877943303376640:0@lo:400:kworker.0 00010000:00080000:3.0:1790946659.832435:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff914698015180 x1877943303377280/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790946675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790946659.832444:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914698015180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1877943303377280:0@lo:400:kworker.0 00002000:00080000:0.0:1790946659.834326:0:15170:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1790946659.834336:0:15170:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1790946659.836469:0:15170:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1790946659.836504:0:15170:0:(import.c:65:import_set_state_nolock()) ffff9146aa74c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790946659.836601:0:15170:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914698017480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3299:x1877943303376896:12345-0@lo:8:kworker.0 Request processed in 4929us (6200us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946659.836612:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1790946659.836667:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff914698014000 x1877943303376896/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790946684 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1790946659.836681:0:3299:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1790946659.836689:0:3299:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1790946659.836695:0:3299:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1790946659.836697:0:3299:0:(import.c:65:import_set_state_nolock()) ffff9146851e9000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1790946659.836762:0:3299:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1790946659.836778:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914698014000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1877943303376896:0@lo:8:kworker.0 00000004:00080000:1.0:1790946659.836833:0:14511:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:0.0:1790946659.837456:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91468e93ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303377408:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790946659.837505:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1790946659.837604:0:14510:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1790946659.838362:0:14510:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 444910160142ns, next at 0ns, rc = 0 00000100:00100000:0.0:1790946659.838424:0:15172:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303377408 00000100:00100000:0.0:1790946659.838431:0:15172:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303377408 00000100:00100000:0.0:1790946659.838479:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790946659.838488:0:15172:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be98ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1877943303377408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790946659.838515:0:15172:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1790946659.841129:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790946659.841391:0:14511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91468e93d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14511:1877943303377536:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1790946659.841761:0:15172:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be98ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1877943303377408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3269us (4251us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946659.841771:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1790946659.841823:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91468e93ed80 x1877943303377408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790946675 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790946659.841846:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91468e93ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303377408:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790946659.842159:0:14511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946659.842183:0:14511:0:(client.c:2716:ptlrpc_set_wait()) set ffff914586872480 going to sleep for 11 seconds 00000100:00100000:1.0:1790946659.844518:0:15171:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303377536 00000100:00100000:1.0:1790946659.844541:0:15171:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303377536 00000100:00100000:1.0:1790946659.844593:0:15171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790946659.844602:0:15171:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468e93d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14511:x1877943303377536:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1790946659.850543:0:15171:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1790946659.850554:0:15171:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1790946659.850559:0:15171:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:1.0:1790946659.870807:0:15171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790946659.870818:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006541faf7/0x16e41aef93272f60 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.870835:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1790946659.870839:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946659.870845:0:15171:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006541faf7/0x16e41aef93272f60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.873010:0:15171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006541faf7/0x16e41aef93272f60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.873029:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006541faf7/0x16e41aef93272f60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.873039:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006541faf7/0x16e41aef93272f60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.873072:0:15171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790946659.873086:0:14474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790946659.873092:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006541faf7/0x16e41aef93272f60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.873100:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914680030000 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:1.0:1790946659.873104:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006541faf7/0x16e41aef93272f60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.873131:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006541faf7/0x16e41aef93272f60 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.873147:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006541faf7/0x16e41aef93272f60 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.873154:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006541faf7/0x16e41aef93272f60 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.873176:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946659.873178:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946659.873180:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790946659.873841:0:15171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790946659.873849:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001979b2cc/0x16e41aef93272f67 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.873872:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1790946659.873877:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946659.873883:0:15171:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001979b2cc/0x16e41aef93272f67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.873893:0:15171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001979b2cc/0x16e41aef93272f67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.873901:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001979b2cc/0x16e41aef93272f67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.873915:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001979b2cc/0x16e41aef93272f67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.873931:0:15171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790946659.873942:0:14475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790946659.873947:0:14475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001979b2cc/0x16e41aef93272f67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.873953:0:14475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914680030600 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:1.0:1790946659.873957:0:14475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001979b2cc/0x16e41aef93272f67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.873964:0:14475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001979b2cc/0x16e41aef93272f67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.873974:0:14475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001979b2cc/0x16e41aef93272f67 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.873981:0:14475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001979b2cc/0x16e41aef93272f67 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.873994:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946659.873995:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946659.873997:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790946659.874396:0:15171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790946659.874410:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d54e189a/0x16e41aef93272f6e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.874419:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1790946659.874422:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946659.874425:0:15171:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d54e189a/0x16e41aef93272f6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.874435:0:15171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d54e189a/0x16e41aef93272f6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.874442:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d54e189a/0x16e41aef93272f6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.874449:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d54e189a/0x16e41aef93272f6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.874462:0:15171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790946659.874470:0:14474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790946659.874473:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d54e189a/0x16e41aef93272f6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.874479:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914680031e00 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:1.0:1790946659.874483:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d54e189a/0x16e41aef93272f6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.874490:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d54e189a/0x16e41aef93272f6e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.874506:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d54e189a/0x16e41aef93272f6e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.874513:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d54e189a/0x16e41aef93272f6e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.874526:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946659.874528:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946659.874530:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790946659.880763:0:15171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790946659.880774:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c65f1ec9/0x16e41aef93272f75 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.880790:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1790946659.880795:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946659.880801:0:15171:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c65f1ec9/0x16e41aef93272f75 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.880815:0:15171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c65f1ec9/0x16e41aef93272f75 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.880826:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c65f1ec9/0x16e41aef93272f75 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.880833:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c65f1ec9/0x16e41aef93272f75 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.880882:0:15171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1790946659.881430:0:15171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790946659.881437:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac3db502/0x16e41aef93272f7c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.881448:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1790946659.881451:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946659.881454:0:15171:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac3db502/0x16e41aef93272f7c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.881463:0:15171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac3db502/0x16e41aef93272f7c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.881470:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac3db502/0x16e41aef93272f7c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.881477:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac3db502/0x16e41aef93272f7c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.881492:0:15171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1790946659.881502:0:14474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790946659.881507:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c65f1ec9/0x16e41aef93272f75 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.881515:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914680030c00 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:1.0:1790946659.881538:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c65f1ec9/0x16e41aef93272f75 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.881549:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c65f1ec9/0x16e41aef93272f75 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.881565:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c65f1ec9/0x16e41aef93272f75 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.881573:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c65f1ec9/0x16e41aef93272f75 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.881589:0:14474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790946659.881592:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac3db502/0x16e41aef93272f7c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.881598:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914680031200 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:1.0:1790946659.881600:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac3db502/0x16e41aef93272f7c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.881607:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac3db502/0x16e41aef93272f7c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.881615:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac3db502/0x16e41aef93272f7c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.881621:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac3db502/0x16e41aef93272f7c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.881637:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946659.881638:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946659.881640:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790946659.882034:0:15171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790946659.882040:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fbcc13b2/0x16e41aef93272f83 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.882049:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1790946659.882051:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946659.882055:0:15171:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fbcc13b2/0x16e41aef93272f83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.882063:0:15171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fbcc13b2/0x16e41aef93272f83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.882070:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fbcc13b2/0x16e41aef93272f83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.882078:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fbcc13b2/0x16e41aef93272f83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.882092:0:15171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790946659.882098:0:14474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790946659.882101:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fbcc13b2/0x16e41aef93272f83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.882118:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914680031a00 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:1.0:1790946659.882120:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fbcc13b2/0x16e41aef93272f83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.882127:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fbcc13b2/0x16e41aef93272f83 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.882137:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fbcc13b2/0x16e41aef93272f83 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.882144:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fbcc13b2/0x16e41aef93272f83 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.882155:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946659.882156:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946659.882158:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790946659.882554:0:15171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790946659.882560:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000062a74f1/0x16e41aef93272f8a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.882568:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1790946659.882571:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946659.882575:0:15171:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000062a74f1/0x16e41aef93272f8a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.882584:0:15171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000062a74f1/0x16e41aef93272f8a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.882599:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000062a74f1/0x16e41aef93272f8a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.882607:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000062a74f1/0x16e41aef93272f8a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.882619:0:15171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790946659.882627:0:14474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790946659.882630:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000062a74f1/0x16e41aef93272f8a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.882636:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914680030a00 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:1.0:1790946659.882639:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000062a74f1/0x16e41aef93272f8a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.882646:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000062a74f1/0x16e41aef93272f8a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.882655:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000062a74f1/0x16e41aef93272f8a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.882662:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000062a74f1/0x16e41aef93272f8a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.882675:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946659.882682:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946659.882684:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790946659.883063:0:15171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790946659.883069:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000711c5f3a/0x16e41aef93272f91 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.883077:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1790946659.883080:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946659.883084:0:15171:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000711c5f3a/0x16e41aef93272f91 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.883093:0:15171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000711c5f3a/0x16e41aef93272f91 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.883102:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000711c5f3a/0x16e41aef93272f91 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.883109:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000711c5f3a/0x16e41aef93272f91 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.883123:0:15171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790946659.883130:0:14474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790946659.883134:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000711c5f3a/0x16e41aef93272f91 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.883141:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914680031600 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:1.0:1790946659.883145:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000711c5f3a/0x16e41aef93272f91 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.883164:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000711c5f3a/0x16e41aef93272f91 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.883176:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000711c5f3a/0x16e41aef93272f91 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.883183:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000711c5f3a/0x16e41aef93272f91 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.883196:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946659.883222:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946659.883224:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946659.883570:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790946659.884900:0:15171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790946659.884911:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051d6df61/0x16e41aef93272f98 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.884924:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1790946659.884928:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946659.884934:0:15171:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051d6df61/0x16e41aef93272f98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.884947:0:15171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051d6df61/0x16e41aef93272f98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.884959:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051d6df61/0x16e41aef93272f98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.884973:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051d6df61/0x16e41aef93272f98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.885027:0:15171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1790946659.885474:0:15171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790946659.885480:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004357f1f7/0x16e41aef93272f9f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.885489:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1790946659.885492:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946659.885495:0:15171:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004357f1f7/0x16e41aef93272f9f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.885503:0:15171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004357f1f7/0x16e41aef93272f9f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.885510:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004357f1f7/0x16e41aef93272f9f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.885517:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004357f1f7/0x16e41aef93272f9f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946659.888753:0:14474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790946659.888766:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051d6df61/0x16e41aef93272f98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946659.888780:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180ea00 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:0.0:1790946659.888784:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051d6df61/0x16e41aef93272f98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946659.888808:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051d6df61/0x16e41aef93272f98 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946659.888830:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051d6df61/0x16e41aef93272f98 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946659.888839:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051d6df61/0x16e41aef93272f98 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946659.888880:0:14474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790946659.888883:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004357f1f7/0x16e41aef93272f9f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946659.888889:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180e600 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:0.0:1790946659.888892:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004357f1f7/0x16e41aef93272f9f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946659.888899:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004357f1f7/0x16e41aef93272f9f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946659.888908:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004357f1f7/0x16e41aef93272f9f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946659.888914:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946659.888915:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946659.888922:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946659.892909:0:15171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1790946659.892924:0:15171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004357f1f7/0x16e41aef93272f9f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.892974:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790946659.893778:0:15171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790946659.893787:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000291eb6b/0x16e41aef93272fa6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.893801:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1790946659.893806:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946659.893812:0:15171:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000291eb6b/0x16e41aef93272fa6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.893828:0:15171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000291eb6b/0x16e41aef93272fa6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.893837:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000291eb6b/0x16e41aef93272fa6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.893844:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000291eb6b/0x16e41aef93272fa6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.895112:0:15171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790946659.895836:0:14474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946659.895846:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000291eb6b/0x16e41aef93272fa6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946659.895872:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180f000 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:2.0:1790946659.895877:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000291eb6b/0x16e41aef93272fa6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946659.895888:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000291eb6b/0x16e41aef93272fa6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946659.895909:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000291eb6b/0x16e41aef93272fa6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946659.895916:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000291eb6b/0x16e41aef93272fa6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946659.895942:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946659.895943:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946659.895945:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790946659.897251:0:15171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790946659.897262:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004357f1f7/0x16e41aef93272fad lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.897277:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1790946659.897287:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946659.897294:0:15171:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004357f1f7/0x16e41aef93272fad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.897307:0:15171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004357f1f7/0x16e41aef93272fad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.897318:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004357f1f7/0x16e41aef93272fad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.897327:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004357f1f7/0x16e41aef93272fad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.897345:0:15171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790946659.897356:0:14475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790946659.897361:0:14475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004357f1f7/0x16e41aef93272fad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.897369:0:14475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180e600 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:1.0:1790946659.897373:0:14475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004357f1f7/0x16e41aef93272fad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.897382:0:14475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004357f1f7/0x16e41aef93272fad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.897395:0:14475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004357f1f7/0x16e41aef93272fad lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.897413:0:14475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004357f1f7/0x16e41aef93272fad lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.897429:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946659.897431:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946659.897433:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790946659.900999:0:15171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790946659.901011:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087470073/0x16e41aef93272fb4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.901027:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1790946659.901032:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946659.901039:0:15171:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087470073/0x16e41aef93272fb4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.901053:0:15171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087470073/0x16e41aef93272fb4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.901062:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087470073/0x16e41aef93272fb4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.901069:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087470073/0x16e41aef93272fb4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.901120:0:15171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1790946659.906041:0:15171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790946659.906066:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6f82bba/0x16e41aef93272fbb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.906084:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1790946659.906090:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946659.906096:0:15171:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6f82bba/0x16e41aef93272fbb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.906111:0:15171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6f82bba/0x16e41aef93272fbb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.906121:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6f82bba/0x16e41aef93272fbb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.906129:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d6f82bba/0x16e41aef93272fbb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946659.908675:0:14474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790946659.908689:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087470073/0x16e41aef93272fb4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946659.908701:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180f800 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:2.0:1790946659.908706:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087470073/0x16e41aef93272fb4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946659.908716:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087470073/0x16e41aef93272fb4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946659.908735:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087470073/0x16e41aef93272fb4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946659.908742:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087470073/0x16e41aef93272fb4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946659.908764:0:14474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946659.908768:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d6f82bba/0x16e41aef93272fbb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946659.908774:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180e200 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:2.0:1790946659.908788:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6f82bba/0x16e41aef93272fbb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946659.908797:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6f82bba/0x16e41aef93272fbb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946659.908807:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d6f82bba/0x16e41aef93272fbb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946659.908815:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946659.908816:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946659.908818:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946659.914082:0:15171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1790946659.914096:0:15171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6f82bba/0x16e41aef93272fbb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790946659.914716:0:15171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790946659.914723:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e13b794/0x16e41aef93272fc2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.914737:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1790946659.914741:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946659.914753:0:15171:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e13b794/0x16e41aef93272fc2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.914767:0:15171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e13b794/0x16e41aef93272fc2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.914776:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e13b794/0x16e41aef93272fc2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.914783:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e13b794/0x16e41aef93272fc2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.914802:0:15171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790946659.914815:0:14474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790946659.914820:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e13b794/0x16e41aef93272fc2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.914828:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180f200 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:1.0:1790946659.914832:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e13b794/0x16e41aef93272fc2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.914840:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e13b794/0x16e41aef93272fc2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.914855:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e13b794/0x16e41aef93272fc2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.914885:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e13b794/0x16e41aef93272fc2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.914900:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946659.914902:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946659.914903:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790946659.915305:0:15171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790946659.915312:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb13ef42/0x16e41aef93272fc9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.915321:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1790946659.915325:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946659.915329:0:15171:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb13ef42/0x16e41aef93272fc9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.915339:0:15171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb13ef42/0x16e41aef93272fc9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.915347:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb13ef42/0x16e41aef93272fc9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.915356:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb13ef42/0x16e41aef93272fc9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.915368:0:15171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790946659.915375:0:14474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790946659.915385:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb13ef42/0x16e41aef93272fc9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.915392:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180e000 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:1.0:1790946659.915395:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb13ef42/0x16e41aef93272fc9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.915403:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb13ef42/0x16e41aef93272fc9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.915413:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb13ef42/0x16e41aef93272fc9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.915420:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb13ef42/0x16e41aef93272fc9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.915432:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946659.915434:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946659.915436:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790946659.915804:0:15171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790946659.915810:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af644160/0x16e41aef93272fd0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.915819:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1790946659.915822:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946659.915826:0:15171:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af644160/0x16e41aef93272fd0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.915846:0:15171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af644160/0x16e41aef93272fd0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.915855:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af644160/0x16e41aef93272fd0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.915877:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af644160/0x16e41aef93272fd0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.915890:0:15171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790946659.915898:0:14474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790946659.915902:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af644160/0x16e41aef93272fd0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.915909:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180fe00 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:1.0:1790946659.915913:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af644160/0x16e41aef93272fd0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.915921:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af644160/0x16e41aef93272fd0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.915931:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af644160/0x16e41aef93272fd0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.915938:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af644160/0x16e41aef93272fd0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.915957:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946659.915959:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946659.915961:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790946659.916346:0:15171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790946659.916352:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082fd253f/0x16e41aef93272fd7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.916360:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1790946659.916363:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946659.916367:0:15171:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082fd253f/0x16e41aef93272fd7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.916376:0:15171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082fd253f/0x16e41aef93272fd7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.916383:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082fd253f/0x16e41aef93272fd7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.916391:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000082fd253f/0x16e41aef93272fd7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.916405:0:15171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790946659.916413:0:14474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790946659.916417:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000082fd253f/0x16e41aef93272fd7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.916434:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180fa00 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:1.0:1790946659.916437:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000082fd253f/0x16e41aef93272fd7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.916445:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000082fd253f/0x16e41aef93272fd7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.916455:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000082fd253f/0x16e41aef93272fd7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.916463:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082fd253f/0x16e41aef93272fd7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.916476:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946659.916478:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946659.916480:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790946659.916981:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790946659.918338:0:15171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790946659.918348:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067644636/0x16e41aef93272fde lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.918362:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1790946659.918365:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946659.918371:0:15171:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067644636/0x16e41aef93272fde lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.918383:0:15171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067644636/0x16e41aef93272fde lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.918401:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067644636/0x16e41aef93272fde lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.918408:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067644636/0x16e41aef93272fde lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.918422:0:15171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790946659.918618:0:14474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946659.918627:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067644636/0x16e41aef93272fde lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946659.918635:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180fc00 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:2.0:1790946659.918639:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067644636/0x16e41aef93272fde lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946659.918648:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067644636/0x16e41aef93272fde lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946659.918664:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067644636/0x16e41aef93272fde lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946659.918671:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067644636/0x16e41aef93272fde lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946659.918695:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946659.918697:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946659.918698:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790946659.919148:0:15171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790946659.919155:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087470073/0x16e41aef93272fe5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.919164:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1790946659.919167:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946659.919171:0:15171:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087470073/0x16e41aef93272fe5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.919181:0:15171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087470073/0x16e41aef93272fe5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.919189:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087470073/0x16e41aef93272fe5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.919197:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087470073/0x16e41aef93272fe5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.920687:0:15171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790946659.920702:0:14475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790946659.920707:0:14475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087470073/0x16e41aef93272fe5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.920714:0:14475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180f800 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:1.0:1790946659.920718:0:14475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087470073/0x16e41aef93272fe5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.920728:0:14475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087470073/0x16e41aef93272fe5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.920744:0:14475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087470073/0x16e41aef93272fe5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.920751:0:14475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087470073/0x16e41aef93272fe5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.920769:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946659.920770:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946659.920772:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790946659.921322:0:15171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790946659.921329:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000291eb6b/0x16e41aef93272fec lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.921340:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1790946659.921348:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946659.921354:0:15171:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000291eb6b/0x16e41aef93272fec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.921366:0:15171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000291eb6b/0x16e41aef93272fec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.921374:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000291eb6b/0x16e41aef93272fec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.921381:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000291eb6b/0x16e41aef93272fec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.921396:0:15171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790946659.921406:0:14474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790946659.921410:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000291eb6b/0x16e41aef93272fec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.921417:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180f000 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:1.0:1790946659.921421:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000291eb6b/0x16e41aef93272fec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.921429:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000291eb6b/0x16e41aef93272fec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.921440:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000291eb6b/0x16e41aef93272fec lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.921458:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000291eb6b/0x16e41aef93272fec lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.921472:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946659.921474:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946659.921475:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790946659.921870:0:15171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790946659.921876:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051d6df61/0x16e41aef93272ff3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.921885:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1790946659.921888:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946659.921892:0:15171:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051d6df61/0x16e41aef93272ff3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.921901:0:15171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051d6df61/0x16e41aef93272ff3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.921909:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051d6df61/0x16e41aef93272ff3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.921916:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051d6df61/0x16e41aef93272ff3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.921930:0:15171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790946659.921939:0:14475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790946659.921948:0:14475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051d6df61/0x16e41aef93272ff3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.921956:0:14475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180ea00 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:1.0:1790946659.921959:0:14475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051d6df61/0x16e41aef93272ff3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.921968:0:14475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051d6df61/0x16e41aef93272ff3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.921979:0:14475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051d6df61/0x16e41aef93272ff3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.921987:0:14475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051d6df61/0x16e41aef93272ff3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.922002:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946659.922004:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946659.922005:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790946659.922435:0:15171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790946659.922441:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000711c5f3a/0x16e41aef93272ffa lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.922450:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1790946659.922453:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946659.922457:0:15171:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000711c5f3a/0x16e41aef93272ffa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.922475:0:15171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000711c5f3a/0x16e41aef93272ffa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.922483:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000711c5f3a/0x16e41aef93272ffa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.922490:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000711c5f3a/0x16e41aef93272ffa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.922503:0:15171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790946659.922511:0:14474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790946659.922514:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000711c5f3a/0x16e41aef93272ffa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.922520:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914680031600 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:1.0:1790946659.922523:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000711c5f3a/0x16e41aef93272ffa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.922530:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000711c5f3a/0x16e41aef93272ffa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.922539:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000711c5f3a/0x16e41aef93272ffa lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.922546:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000711c5f3a/0x16e41aef93272ffa lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.922566:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946659.922567:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946659.922569:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790946659.933252:0:15171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790946659.933268:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000062a74f1/0x16e41aef93273001 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.933287:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=445s v=(0 0) 00010000:00010000:1.0:1790946659.933292:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946659.933299:0:15171:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000062a74f1/0x16e41aef93273001 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.933316:0:15171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000062a74f1/0x16e41aef93273001 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.933326:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000062a74f1/0x16e41aef93273001 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.933336:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000062a74f1/0x16e41aef93273001 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.933361:0:15171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790946659.933377:0:14475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790946659.933383:0:14475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000062a74f1/0x16e41aef93273001 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.933402:0:14475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914680030a00 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:1.0:1790946659.933407:0:14475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000062a74f1/0x16e41aef93273001 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.933416:0:14475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000062a74f1/0x16e41aef93273001 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.933432:0:14475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000062a74f1/0x16e41aef93273001 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.933440:0:14475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000062a74f1/0x16e41aef93273001 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.933455:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946659.933457:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946659.933459:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790946659.934030:0:15171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790946659.934036:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fbcc13b2/0x16e41aef93273008 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.934046:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=445s v=(0 0) 00010000:00010000:1.0:1790946659.934050:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946659.934054:0:15171:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fbcc13b2/0x16e41aef93273008 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.934064:0:15171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fbcc13b2/0x16e41aef93273008 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.934079:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fbcc13b2/0x16e41aef93273008 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.934086:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fbcc13b2/0x16e41aef93273008 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.934102:0:15171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790946659.934112:0:14474:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790946659.934117:0:14474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fbcc13b2/0x16e41aef93273008 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.934123:0:14474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914680031a00 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:1.0:1790946659.934126:0:14474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fbcc13b2/0x16e41aef93273008 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.934133:0:14474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fbcc13b2/0x16e41aef93273008 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.934144:0:14474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fbcc13b2/0x16e41aef93273008 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.934151:0:14474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fbcc13b2/0x16e41aef93273008 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.934165:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946659.934171:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946659.934173:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790946659.935064:0:15171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790946659.935071:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac3db502/0x16e41aef9327300f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.935083:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=445s v=(0 0) 00010000:00010000:1.0:1790946659.935086:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946659.935091:0:15171:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac3db502/0x16e41aef9327300f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.935101:0:15171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac3db502/0x16e41aef9327300f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.935110:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac3db502/0x16e41aef9327300f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.935119:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac3db502/0x16e41aef9327300f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.938993:0:15171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1790946659.939637:0:15171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790946659.939646:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c65f1ec9/0x16e41aef93273016 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.939663:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=445s v=(0 0) 00010000:00010000:1.0:1790946659.939667:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946659.939672:0:15171:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c65f1ec9/0x16e41aef93273016 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.939692:0:15171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c65f1ec9/0x16e41aef93273016 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.939702:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c65f1ec9/0x16e41aef93273016 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.939710:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c65f1ec9/0x16e41aef93273016 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790946659.940033:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:2.0:1790946659.942649:0:14475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790946659.942664:0:14475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac3db502/0x16e41aef9327300f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946659.942679:0:14475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914680031200 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:2.0:1790946659.942685:0:14475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac3db502/0x16e41aef9327300f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946659.942696:0:14475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac3db502/0x16e41aef9327300f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946659.942719:0:14475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac3db502/0x16e41aef9327300f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946659.942727:0:14475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac3db502/0x16e41aef9327300f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946659.942751:0:14475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946659.942755:0:14475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c65f1ec9/0x16e41aef93273016 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946659.942760:0:14475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914680030c00 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:2.0:1790946659.942771:0:14475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c65f1ec9/0x16e41aef93273016 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946659.942778:0:14475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c65f1ec9/0x16e41aef93273016 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946659.942789:0:14475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c65f1ec9/0x16e41aef93273016 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946659.942797:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946659.942808:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946659.942810:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946659.950799:0:15171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1790946659.950812:0:15171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c65f1ec9/0x16e41aef93273016 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946659.950848:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1790946659.951181:0:15171:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:1.0:1790946659.951291:0:15171:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468e93d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14511:x1877943303377536:12345-0@lo:5:osp-pre-1-0.0 Request processed in 106686us (109128us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946659.951301:0:15171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790946659.951348:0:14511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91468e93d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14511:1877943303377536:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1790946659.951361:0:14511:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:1.0:1790946659.951400:0:14511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91468e93d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14511:1877943303377664:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1790946659.951430:0:14511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946659.952656:0:14511:0:(client.c:2716:ptlrpc_set_wait()) set ffff914586872480 going to sleep for 11 seconds 00000100:00100000:1.0:1790946659.952680:0:15170:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303377664 00000100:00100000:1.0:1790946659.952698:0:15170:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303377664 00000100:00100000:1.0:1790946659.952751:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790946659.952759:0:15170:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468e93ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14511:x1877943303377664:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1790946659.952799:0:15170:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:1.0:1790946659.965322:0:15170:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468e93ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14511:x1877943303377664:12345-0@lo:5:osp-pre-1-0.0 Request processed in 12555us (13883us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1790946659.965336:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790946659.968844:0:14511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91468e93d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14511:1877943303377664:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1790946659.969008:0:14511:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:3.0:1790946660.534287:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790946661.557029:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790946661.919103:0:16245:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1790946662.580615:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946662.896802:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5a69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303377792:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790946662.896885:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946662.896960:0:15172:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303377792 00000100:00100000:3.0:1790946662.896968:0:15172:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303377792 00000100:00100000:3.0:1790946662.897033:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790946662.897042:0:15172:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914698015180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303377792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790946662.897077:0:15172:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790946662.897118:0:15172:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914698015180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303377792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946662.897132:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790946662.897179:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5a69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303377792:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1790946662.897300:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790946663.600654:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790946664.176852:0:14517:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1790946664.363780:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946664.365162:0:14481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286603648 00000100:00100000:3.0:1790946664.365181:0:14481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286603648 00000100:00100000:3.0:1790946664.365365:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 74 00000100:00100000:3.0:1790946664.365376:0:14481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468872bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2360:x1877943286603648:12345-192.168.203.13@tcp:250:mount.lustre.0 00010000:00080000:3.0:1790946664.365525:0:14481:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 297779ff-2cb2-4723-b8d5-25521c7fc733@192.168.203.13@tcp t0 exp 0000000000000000 cur 449 last 0 00000020:00000080:3.0:1790946664.365570:0:14481:0:(genops.c:1384:class_connect()) connect: client 297779ff-2cb2-4723-b8d5-25521c7fc733, cookie 0x16e41aef9327301d 00000100:00080000:3.0:1790946664.365756:0:14481:0:(import.c:65:import_set_state_nolock()) ffff9146b5a4a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790946664.366559:0:14481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468872bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:297779ff-2cb2-4723-b8d5-25521c7fc733+5:2360:x1877943286603648:12345-192.168.203.13@tcp:250:mount.lustre.0 Request processed in 1178us (2787us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946664.366571:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 74 00000100:00100000:1.0:1790946664.388421:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946664.388813:0:14478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286603776 00000100:00100000:2.0:1790946664.388835:0:14478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286603776 00000100:00100000:2.0:1790946664.388904:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 75 00000100:00100000:2.0:1790946664.388916:0:14478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468872a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:297779ff-2cb2-4723-b8d5-25521c7fc733+5:13749:x1877943286603776:12345-192.168.203.13@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790946664.388937:0:14478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946664.388958:0:14478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff914688aef400/0x16e41aef93273024 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x826f92adbe0d033 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946664.388994:0:14478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff914688aef400/0x16e41aef93273024 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d033 expref: 6 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946664.389022:0:14478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff914688aef400/0x16e41aef93273024 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d033 expref: 6 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946664.389033:0:14478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914688aef400, rc 0) 00000100:00100000:2.0:1790946664.389099:0:14478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468872a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:297779ff-2cb2-4723-b8d5-25521c7fc733+6:13749:x1877943286603776:12345-192.168.203.13@tcp:101:mount.lustre.0 Request processed in 186us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946664.389107:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 75 00000100:00100000:2.0:1790946664.392479:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946664.392586:0:14481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286603904 00000100:00100000:3.0:1790946664.392599:0:14481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286603904 00000100:00100000:3.0:1790946664.392657:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 76 00000100:00100000:3.0:1790946664.392668:0:14481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914688728050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:297779ff-2cb2-4723-b8d5-25521c7fc733+6:13749:x1877943286603904:12345-192.168.203.13@tcp:501:mount.lustre.0 00000100:00100000:3.0:1790946664.393575:0:14481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914688728050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:297779ff-2cb2-4723-b8d5-25521c7fc733+6:13749:x1877943286603904:12345-192.168.203.13@tcp:501:mount.lustre.0 Request processed in 902us (1103us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790946664.393587:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 76 00000100:00100000:3.0:1790946664.401877:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946664.402078:0:14480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286604032 00000100:00100000:1.0:1790946664.402092:0:14480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286604032 00000100:00100000:1.0:1790946664.402161:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 77 00000100:00100000:1.0:1790946664.402172:0:14480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b583c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:297779ff-2cb2-4723-b8d5-25521c7fc733+6:13749:x1877943286604032:12345-192.168.203.13@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790946664.402194:0:14480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946664.402490:0:14480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff914680030000/0x16e41aef9327302b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x826f92adbe0d03a expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946664.402530:0:14480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff914680030000/0x16e41aef9327302b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d03a expref: 7 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946664.402543:0:14480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff914680030000/0x16e41aef9327302b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d03a expref: 7 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946664.402553:0:14480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914680030000, rc 0) 00000100:00100000:1.0:1790946664.402754:0:14480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b583c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:297779ff-2cb2-4723-b8d5-25521c7fc733+7:13749:x1877943286604032:12345-192.168.203.13@tcp:101:mount.lustre.0 Request processed in 581us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946664.402762:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 77 00000100:00100000:1.0:1790946664.416469:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946664.416671:0:14481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286604160 00000100:00100000:3.0:1790946664.416684:0:14481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286604160 00000100:00100000:3.0:1790946664.416740:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 78 00000100:00100000:3.0:1790946664.416749:0:14481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b583f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:297779ff-2cb2-4723-b8d5-25521c7fc733+7:13749:x1877943286604160:12345-192.168.203.13@tcp:501:mount.lustre.0 00000100:00100000:3.0:1790946664.419448:0:14481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b583f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:297779ff-2cb2-4723-b8d5-25521c7fc733+8:13749:x1877943286604160:12345-192.168.203.13@tcp:501:mount.lustre.0 Request processed in 2682us (2975us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946664.419466:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 78 00000100:00100000:2.0:1790946664.427448:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946664.427539:0:14480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286604288 00000100:00100000:1.0:1790946664.427553:0:14480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286604288 00000100:00100000:1.0:1790946664.427648:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 79 00000100:00100000:1.0:1790946664.427659:0:14480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b583d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:297779ff-2cb2-4723-b8d5-25521c7fc733+8:13749:x1877943286604288:12345-192.168.203.13@tcp:503:mount.lustre.0 00000100:00100000:1.0:1790946664.428045:0:14480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b583d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:297779ff-2cb2-4723-b8d5-25521c7fc733+8:13749:x1877943286604288:12345-192.168.203.13@tcp:503:mount.lustre.0 Request processed in 387us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946664.428054:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 79 00000100:00100000:3.0:1790946664.434757:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946664.435544:0:14478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286604416 00000100:00100000:1.0:1790946664.435559:0:14478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286604416 00000100:00100000:1.0:1790946664.435947:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 80 00000100:00100000:1.0:1790946664.435961:0:14478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b583dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:297779ff-2cb2-4723-b8d5-25521c7fc733+8:13767:x1877943286604416:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790946664.436465:0:14478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b583dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:297779ff-2cb2-4723-b8d5-25521c7fc733+8:13767:x1877943286604416:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 506us (1720us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946664.436475:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 80 00000100:00100000:1.0:1790946664.467135:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946664.469014:0:14480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286604544 00000100:00100000:3.0:1790946664.469034:0:14480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286604544 00000100:00100000:2.0:1790946664.469663:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 81 00000100:00100000:2.0:1790946664.469679:0:14480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b583ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:297779ff-2cb2-4723-b8d5-25521c7fc733+8:13767:x1877943286604544:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790946664.470374:0:14480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b583ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:297779ff-2cb2-4723-b8d5-25521c7fc733+8:13767:x1877943286604544:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 694us (3249us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946664.470387:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 81 00000100:00100000:0.0:1790946664.477842:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946664.477994:0:14478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286604672 00000100:00100000:1.0:1790946664.478007:0:14478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286604672 00000100:00100000:1.0:1790946664.478175:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 82 00000100:00100000:1.0:1790946664.478188:0:14478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b583f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:297779ff-2cb2-4723-b8d5-25521c7fc733+8:13749:x1877943286604672:12345-192.168.203.13@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790946664.478239:0:14478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946664.478262:0:14478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff914680030a00/0x16e41aef93273032 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x826f92adbe0d064 expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946664.478298:0:14478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff914680030a00/0x16e41aef93273032 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d064 expref: 9 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946664.478311:0:14478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff914680030a00/0x16e41aef93273032 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d064 expref: 9 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946664.478339:0:14478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914680030a00, rc 0) 00000100:00100000:1.0:1790946664.478416:0:14478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b583f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:297779ff-2cb2-4723-b8d5-25521c7fc733+9:13749:x1877943286604672:12345-192.168.203.13@tcp:101:mount.lustre.0 Request processed in 229us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946664.478423:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 82 00000100:00100000:0.0:1790946664.485923:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946664.486034:0:14480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286604800 00000100:00100000:1.0:1790946664.486048:0:14480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286604800 00000100:00100000:1.0:1790946664.486129:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 83 00000100:00100000:1.0:1790946664.486140:0:14480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b583c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:297779ff-2cb2-4723-b8d5-25521c7fc733+9:13749:x1877943286604800:12345-192.168.203.13@tcp:256:mount.lustre.0 20000000:01000000:1.0:1790946664.486179:0:14480:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1790946664.486236:0:14480:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1790946664.486241:0:14480:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1790946664.486246:0:14480:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1790946664.486257:0:14480:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1790946664.488446:0:14480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b583c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:297779ff-2cb2-4723-b8d5-25521c7fc733+9:13749:x1877943286604800:12345-192.168.203.13@tcp:256:mount.lustre.0 Request processed in 2291us (2521us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946664.488463:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 83 00000100:00100000:0.0:1790946664.492790:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946664.492905:0:14478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286604928 00000100:00100000:1.0:1790946664.492921:0:14478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286604928 00000100:00100000:1.0:1790946664.492988:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 84 00000100:00100000:1.0:1790946664.493000:0:14478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b583c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:297779ff-2cb2-4723-b8d5-25521c7fc733+9:13749:x1877943286604928:12345-192.168.203.13@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790946664.493023:0:14478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946664.493050:0:14478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff914680031a00/0x16e41aef93273039 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x826f92adbe0d06b expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946664.493142:0:14478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff914680031a00/0x16e41aef93273039 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d06b expref: 10 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946664.493182:0:14478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff914680031a00/0x16e41aef93273039 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d06b expref: 10 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946664.493193:0:14478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914680031a00, rc 0) 00000100:00100000:0.0:1790946664.493937:0:14478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b583c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:297779ff-2cb2-4723-b8d5-25521c7fc733+10:13749:x1877943286604928:12345-192.168.203.13@tcp:101:mount.lustre.0 Request processed in 935us (1159us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946664.493947:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 84 00000100:00100000:0.0:1790946664.499344:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946664.499442:0:14480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286605056 00000100:00100000:1.0:1790946664.499455:0:14480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286605056 00000100:00100000:1.0:1790946664.499519:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 85 00000100:00100000:1.0:1790946664.499530:0:14480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b583e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:297779ff-2cb2-4723-b8d5-25521c7fc733+10:13749:x1877943286605056:12345-192.168.203.13@tcp:501:mount.lustre.0 00000100:00100000:1.0:1790946664.499931:0:14480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b583e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:297779ff-2cb2-4723-b8d5-25521c7fc733+10:13749:x1877943286605056:12345-192.168.203.13@tcp:501:mount.lustre.0 Request processed in 400us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946664.499941:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 85 00000100:00100000:2.0:1790946664.510915:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946664.511024:0:14478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286605184 00000100:00100000:0.0:1790946664.511038:0:14478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286605184 00000100:00100000:0.0:1790946664.511107:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 86 00000100:00100000:0.0:1790946664.511119:0:14478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b583cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:297779ff-2cb2-4723-b8d5-25521c7fc733+10:13749:x1877943286605184:12345-192.168.203.13@tcp:503:mount.lustre.0 00000100:00100000:1.0:1790946664.512123:0:14478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b583cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:297779ff-2cb2-4723-b8d5-25521c7fc733+10:13749:x1877943286605184:12345-192.168.203.13@tcp:503:mount.lustre.0 Request processed in 997us (1212us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946664.512137:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 86 00000100:00100000:0.0:1790946664.520699:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946664.521036:0:14481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286605312 00000100:00100000:3.0:1790946664.521049:0:14481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286605312 00000100:00100000:3.0:1790946664.521117:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 87 00000100:00100000:3.0:1790946664.521128:0:14481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b583e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:297779ff-2cb2-4723-b8d5-25521c7fc733+10:13773:x1877943286605312:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790946664.522244:0:14481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b583e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:297779ff-2cb2-4723-b8d5-25521c7fc733+10:13773:x1877943286605312:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 1109us (1550us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946664.522257:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 87 00000100:00100000:0.0:1790946664.528283:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946664.528606:0:14478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286605440 00000100:00100000:1.0:1790946664.528619:0:14478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286605440 00000100:00100000:1.0:1790946664.528695:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 88 00000100:00100000:1.0:1790946664.528707:0:14478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b583d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:297779ff-2cb2-4723-b8d5-25521c7fc733+10:13773:x1877943286605440:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790946664.529043:0:14478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b583d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:297779ff-2cb2-4723-b8d5-25521c7fc733+10:13773:x1877943286605440:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 337us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946664.529052:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 88 00000100:00100000:2.0:1790946664.537776:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946664.539885:0:14486:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286605568 00000100:00100000:0.0:1790946664.539906:0:14486:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286605568 00000100:00100000:0.0:1790946664.539980:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:0.0:1790946664.539991:0:14486:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5a69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2360:x1877943286605568:12345-192.168.203.13@tcp:38:mount.lustre.0 00010000:00080000:0.0:1790946664.540032:0:14486:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 367257b9-14b9-4792-8ebc-8eea5a9ade3a@192.168.203.13@tcp t0 exp 0000000000000000 cur 449 last 0 00000020:00000080:0.0:1790946664.540094:0:14486:0:(genops.c:1384:class_connect()) connect: client 367257b9-14b9-4792-8ebc-8eea5a9ade3a, cookie 0x16e41aef93273040 00000004:00100000:0.0:1790946664.540136:0:14486:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000001:00000004:0.0:1790946664.540143:0:14486:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1790946664.572383:0:14486:0:(import.c:65:import_set_state_nolock()) ffff9146b7865800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790946664.572617:0:14486:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5a69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:367257b9-14b9-4792-8ebc-8eea5a9ade3a+6:2360:x1877943286605568:12345-192.168.203.13@tcp:38:mount.lustre.0 Request processed in 32624us (34852us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946664.572630:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:0.0:1790946664.579173:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946664.579257:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946664.579359:0:16113:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286605696 00000100:00100000:1.0:1790946664.579373:0:16113:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286605696 00000100:00100000:1.0:1790946664.579463:0:16113:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286605824 00000100:00100000:1.0:1790946664.579467:0:16113:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286605824 00000100:00100000:1.0:1790946664.579528:0:16113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:1.0:1790946664.579540:0:16113:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be98e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:367257b9-14b9-4792-8ebc-8eea5a9ade3a+7:0:x1877943286605696:12345-192.168.203.13@tcp:41:mount.lustre.0 00000004:00000024:1.0:1790946664.579603:0:16113:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1790946664.579713:0:16113:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be98e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:367257b9-14b9-4792-8ebc-8eea5a9ade3a+7:0:x1877943286605696:12345-192.168.203.13@tcp:41:mount.lustre.0 Request processed in 175us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946664.579720:0:16113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:1.0:1790946664.579740:0:16113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:1.0:1790946664.579747:0:16113:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be98df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:367257b9-14b9-4792-8ebc-8eea5a9ade3a+6:13749:x1877943286605824:12345-192.168.203.13@tcp:41:mount.lustre.0 00000004:00000024:1.0:1790946664.579760:0:16113:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1790946664.579784:0:16113:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be98df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:367257b9-14b9-4792-8ebc-8eea5a9ade3a+6:13749:x1877943286605824:12345-192.168.203.13@tcp:41:mount.lustre.0 Request processed in 37us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946664.579790:0:16113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00080000:3.0:1790946664.580549:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790946664.582031:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946664.582129:0:16113:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286605952 00000100:00100000:1.0:1790946664.582141:0:16113:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286605952 00000100:00100000:1.0:1790946664.582243:0:16113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:1.0:1790946664.582255:0:16113:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be98e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:367257b9-14b9-4792-8ebc-8eea5a9ade3a+6:13749:x1877943286605952:12345-192.168.203.13@tcp:40:mount.lustre.0 00000100:00100000:1.0:1790946664.582353:0:16113:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be98e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:367257b9-14b9-4792-8ebc-8eea5a9ade3a+6:13749:x1877943286605952:12345-192.168.203.13@tcp:40:mount.lustre.0 Request processed in 100us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946664.582360:0:16113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:1.0:1790946664.584654:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946664.584699:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946664.584738:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946664.584771:0:15168:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286606080 00000100:00100000:1.0:1790946664.584781:0:15168:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286606080 00000100:00100000:1.0:1790946664.584819:0:15168:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286606208 00000100:00100000:1.0:1790946664.584830:0:15168:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286606208 00000100:00100000:1.0:1790946664.584875:0:15168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:1.0:1790946664.584883:0:15168:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468e93fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2360:x1877943286606080:12345-192.168.203.13@tcp:8:mount.lustre.0 00010000:00080000:1.0:1790946664.584924:0:15168:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 367257b9-14b9-4792-8ebc-8eea5a9ade3a@192.168.203.13@tcp t0 exp 0000000000000000 cur 449 last 0 00000020:00000080:1.0:1790946664.584964:0:15168:0:(genops.c:1384:class_connect()) connect: client 367257b9-14b9-4792-8ebc-8eea5a9ade3a, cookie 0x16e41aef93273047 00002000:00100000:1.0:1790946664.584981:0:15168:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 367257b9-14b9-4792-8ebc-8eea5a9ade3a/ffff9146bec15800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1790946664.585013:0:15168:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00000100:00100000:3.0:1790946664.585680:0:14489:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286606336 00000100:00100000:3.0:1790946664.585688:0:14489:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286606336 00000100:00100000:3.0:1790946664.585740:0:14489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:3.0:1790946664.585750:0:14489:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468e93e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:367257b9-14b9-4792-8ebc-8eea5a9ade3a+6:13749:x1877943286606336:12345-192.168.203.13@tcp:33:mount.lustre.0 00002000:00080000:1.0:1790946664.587733:0:15168:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1790946664.587798:0:15168:0:(import.c:65:import_set_state_nolock()) ffff914682b98800 : changing import state from RECOVER to FULL 00000004:00080000:0.0:1790946664.588614:0:14489:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2779us 00000100:00100000:1.0:1790946664.588791:0:15168:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468e93fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:367257b9-14b9-4792-8ebc-8eea5a9ade3a+6:2360:x1877943286606080:12345-192.168.203.13@tcp:8:mount.lustre.0 Request processed in 3903us (4144us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946664.588804:0:15168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:1.0:1790946664.588859:0:15168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:1.0:1790946664.588866:0:15168:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468e93c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2360:x1877943286606208:12345-192.168.203.13@tcp:8:mount.lustre.0 00010000:00080000:1.0:1790946664.588899:0:15168:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 367257b9-14b9-4792-8ebc-8eea5a9ade3a@192.168.203.13@tcp t0 exp 0000000000000000 cur 449 last 0 00000020:00000080:1.0:1790946664.588934:0:15168:0:(genops.c:1384:class_connect()) connect: client 367257b9-14b9-4792-8ebc-8eea5a9ade3a, cookie 0x16e41aef9327304e 00002000:00100000:1.0:1790946664.588948:0:15168:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 367257b9-14b9-4792-8ebc-8eea5a9ade3a/ffff914684887800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1790946664.588979:0:15168:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:1.0:1790946664.589245:0:15168:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1790946664.589277:0:15168:0:(import.c:65:import_set_state_nolock()) ffff914684885800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790946664.589309:0:15168:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468e93c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:367257b9-14b9-4792-8ebc-8eea5a9ade3a+6:2360:x1877943286606208:12345-192.168.203.13@tcp:8:mount.lustre.0 Request processed in 442us (4570us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946664.589317:0:15168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 10 00000004:00200000:2.0:1790946664.611087:0:14489:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1790946664.611279:0:14489:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468e93e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:367257b9-14b9-4792-8ebc-8eea5a9ade3a+6:13749:x1877943286606336:12345-192.168.203.13@tcp:33:mount.lustre.0 Request processed in 25522us (26570us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946664.611297:0:14489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 0 00010000:00010000:0.0:1790946664.624653:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946664.819149:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946664.823551:0:14488:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286606464 00000100:00100000:0.0:1790946664.823574:0:14488:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286606464 00000100:00100000:0.0:1790946664.823666:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:0.0:1790946664.823679:0:14488:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468e93df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:367257b9-14b9-4792-8ebc-8eea5a9ade3a+6:13794:x1877943286606464:12345-192.168.203.13@tcp:101:mkdir.0 00010000:00010000:0.0:1790946664.823706:0:14488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946664.823740:0:14488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933000/0x16e41aef93273055 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0d095 expref: -99 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946664.823840:0:14488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932a00/0x16e41aef9327305c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946664.823858:0:14488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932a00/0x16e41aef9327305c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946664.823877:0:14488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932a00/0x16e41aef9327305c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790946664.823924:0:14488:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790946664.823928:0:14488:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790946664.825022:0:14488:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932a00/0x16e41aef9327305c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946664.825093:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933000/0x16e41aef93273055 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d095 expref: 8 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946664.825120:0:14488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932a00/0x16e41aef9327305c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d095 expref: 7 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946664.825130:0:14488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff914683831700) 00010000:00010000:0.0:1790946664.825133:0:14488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790946664.825137:0:14488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b1932a00, rc 0) 00000100:00100000:0.0:1790946664.826389:0:14488:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468e93df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:367257b9-14b9-4792-8ebc-8eea5a9ade3a+7:13794:x1877943286606464:12345-192.168.203.13@tcp:101:mkdir.0 Request processed in 2698us (7241us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946664.826402:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:3.0:1790946664.944500:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914698017800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303378176:0@lo:400:kworker.0 00000100:00100000:2.0:1790946664.944569:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914698014380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303378048:0@lo:400:kworker.0 00000100:00100000:3.0:1790946664.944604:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946664.944708:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946664.944783:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914698017100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:3301:1877943303377920:0@lo:400:kworker.0 00000100:00100000:1.0:1790946664.944805:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914698016680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877943303378304:0@lo:400:kworker.0 00000100:00100000:0.0:1790946664.944839:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946664.944870:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914698014000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1877943303378432:0@lo:400:kworker.0 00000100:00100000:1.0:1790946664.944872:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946664.945421:0:14486:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303378304 00000100:00100000:1.0:1790946664.945434:0:14486:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303378304 00000100:00100000:1.0:1790946664.945493:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790946664.945505:0:14486:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468e93c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877943303378304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946664.950593:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946664.950631:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be124a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1877943303378560:0@lo:400:kworker.0 00000100:00100000:0.0:1790946664.950675:0:16113:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303378432 00000100:00100000:0.0:1790946664.950687:0:16113:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303378432 00000100:00100000:3.0:1790946664.950701:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946664.950751:0:14481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303377920 00000100:00100000:0.0:1790946664.950755:0:16113:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303378560 00000100:00100000:3.0:1790946664.950757:0:14481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303377920 00000100:00100000:0.0:1790946664.950760:0:16113:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303378560 00000100:00100000:0.0:1790946664.950791:0:16113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790946664.950803:0:16113:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be98ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1877943303378432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946664.950809:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1790946664.950847:0:14481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b583e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+19:3301:x1877943303377920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946664.950895:0:16113:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be98ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1877943303378432:12345-0@lo:400:kworker.0 Request processed in 94us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946664.950904:0:14481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b583e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+19:3301:x1877943303377920:12345-0@lo:400:kworker.0 Request processed in 58us (6062us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946664.950908:0:16113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790946664.950917:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1790946664.950935:0:16113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790946664.950962:0:16113:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877943303378560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946664.951004:0:16113:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877943303378560:12345-0@lo:400:kworker.0 Request processed in 45us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946664.951012:0:16113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1790946664.951035:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790946664.951075:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914698017100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:3301:1877943303377920:0@lo:400:kworker.0 00000100:00100000:0.0:1790946664.951105:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914698014000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1877943303378432:0@lo:400:kworker.0 00000100:00100000:3.0:1790946664.951839:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be124a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1877943303378560:0@lo:400:kworker.0 00000100:00100000:2.0:1790946664.953879:0:15171:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303378176 00000100:00100000:2.0:1790946664.953898:0:15171:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303378176 00000100:00100000:2.0:1790946664.954078:0:15171:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303378048 00000100:00100000:2.0:1790946664.954082:0:15171:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303378048 00000100:00100000:2.0:1790946664.954122:0:15171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790946664.954133:0:15171:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be127480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3303:x1877943303378176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946664.954255:0:15171:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be127480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3303:x1877943303378176:12345-0@lo:400:kworker.0 Request processed in 124us (9651us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946664.954264:0:15171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790946664.954281:0:15171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790946664.954287:0:15171:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be125500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303378048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946664.954317:0:15171:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be125500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303378048:12345-0@lo:400:kworker.0 Request processed in 30us (9609us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946664.954322:0:15171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790946664.959426:0:14486:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468e93c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877943303378304:12345-0@lo:400:kworker.0 Request processed in 13906us (14536us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946664.959447:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790946664.960057:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5a6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303378688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790946664.960120:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946664.960182:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914698017800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303378176:0@lo:400:kworker.0 00000100:00100000:3.0:1790946664.960260:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914698014380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303378048:0@lo:400:kworker.0 00000100:00100000:1.0:1790946664.961157:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914698016680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877943303378304:0@lo:400:kworker.0 00000100:00080000:1.0:1790946664.961242:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790946664.961249:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790946664.967593:0:15172:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303378688 00000100:00100000:2.0:1790946664.967615:0:15172:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303378688 00000100:00100000:2.0:1790946664.967686:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790946664.967697:0:15172:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be124a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1877943303378688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790946664.967732:0:15172:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790946664.967861:0:15172:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be124a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1877943303378688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 165us (7740us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946664.967869:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790946664.967961:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5a6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303378688:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1790946665.045476:0:7645:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 367257b9-14b9-4792-8ebc-8eea5a9ade3a 00000001:00080000:3.0:1790946665.045570:0:7645:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:3.0:1790946665.045618:0:7645:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1790946665.657662:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946666.674367:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946666.832462:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946666.832573:0:16113:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286606592 00000100:00100000:1.0:1790946666.832587:0:16113:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286606592 00000100:00100000:1.0:1790946666.832690:0:16113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:1.0:1790946666.832712:0:16113:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be98f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:367257b9-14b9-4792-8ebc-8eea5a9ade3a+7:13847:x1877943286606592:12345-192.168.203.13@tcp:41:lfs.0 00000004:00000024:1.0:1790946666.832785:0:16113:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1790946666.832931:0:16113:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be98f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:367257b9-14b9-4792-8ebc-8eea5a9ade3a+7:13847:x1877943286606592:12345-192.168.203.13@tcp:41:lfs.0 Request processed in 222us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946666.832939:0:16113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00080000:0.0:1790946666.833366:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790946666.836436:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946666.836561:0:15172:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286606720 00000100:00100000:2.0:1790946666.836575:0:15172:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286606720 00000100:00100000:2.0:1790946666.836677:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:2.0:1790946666.836689:0:15172:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468e93ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:367257b9-14b9-4792-8ebc-8eea5a9ade3a+6:13847:x1877943286606720:12345-192.168.203.13@tcp:13:lfs.0 00002000:00000024:2.0:1790946666.836757:0:15172:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790946666.836887:0:15172:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468e93ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:367257b9-14b9-4792-8ebc-8eea5a9ade3a+6:13847:x1877943286606720:12345-192.168.203.13@tcp:13:lfs.0 Request processed in 200us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946666.836918:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00080000:0.0:1790946666.837105:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790946666.844849:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946666.844958:0:15172:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286606848 00000100:00100000:2.0:1790946666.844974:0:15172:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286606848 00000100:00100000:2.0:1790946666.849390:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:2.0:1790946666.849416:0:15172:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be125f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:367257b9-14b9-4792-8ebc-8eea5a9ade3a+5:13847:x1877943286606848:12345-192.168.203.13@tcp:13:lfs.0 00002000:00000024:2.0:1790946666.849472:0:15172:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790946666.849597:0:15172:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be125f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:367257b9-14b9-4792-8ebc-8eea5a9ade3a+5:13847:x1877943286606848:12345-192.168.203.13@tcp:13:lfs.0 Request processed in 193us (4768us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946666.849606:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00080000:0.0:1790946666.850973:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790946667.052815:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946667.052990:0:14478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286606976 00000100:00100000:3.0:1790946667.053004:0:14478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286606976 00000100:00100000:3.0:1790946667.053180:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 90 00000100:00100000:3.0:1790946667.053193:0:14478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b79acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:297779ff-2cb2-4723-b8d5-25521c7fc733+10:13880:x1877943286606976:12345-192.168.203.13@tcp:101:mount.lustre.0 00010000:00010000:3.0:1790946667.053257:0:14478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946667.053281:0:14478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9146be9f7000/0x16e41aef93273063 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x826f92adbe0d09c expref: -99 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946667.053316:0:14478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9146be9f7000/0x16e41aef93273063 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d09c expref: 11 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946667.053331:0:14478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9146be9f7000/0x16e41aef93273063 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d09c expref: 11 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946667.053359:0:14478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146be9f7000, rc 0) 00000100:00100000:3.0:1790946667.053438:0:14478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b79acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:297779ff-2cb2-4723-b8d5-25521c7fc733+11:13880:x1877943286606976:12345-192.168.203.13@tcp:101:mount.lustre.0 Request processed in 247us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946667.053446:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 90 00000100:00100000:1.0:1790946667.059685:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946667.059883:0:14480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286607104 00000100:00100000:3.0:1790946667.059898:0:14480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286607104 00000100:00100000:3.0:1790946667.060023:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 91 00000100:00100000:3.0:1790946667.060035:0:14480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b79adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:297779ff-2cb2-4723-b8d5-25521c7fc733+11:13880:x1877943286607104:12345-192.168.203.13@tcp:501:mount.lustre.0 00000100:00100000:3.0:1790946667.060466:0:14480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b79adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:297779ff-2cb2-4723-b8d5-25521c7fc733+11:13880:x1877943286607104:12345-192.168.203.13@tcp:501:mount.lustre.0 Request processed in 431us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946667.060491:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 91 00000100:00100000:1.0:1790946667.063368:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946667.064889:0:14478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286607232 00000100:00100000:3.0:1790946667.064910:0:14478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286607232 00000100:00100000:3.0:1790946667.065008:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 92 00000100:00100000:3.0:1790946667.065021:0:14478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b79ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:297779ff-2cb2-4723-b8d5-25521c7fc733+11:13880:x1877943286607232:12345-192.168.203.13@tcp:503:mount.lustre.0 00000100:00100000:3.0:1790946667.065496:0:14478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b79ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:297779ff-2cb2-4723-b8d5-25521c7fc733+11:13880:x1877943286607232:12345-192.168.203.13@tcp:503:mount.lustre.0 Request processed in 475us (2139us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946667.065506:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 92 00000100:00100000:1.0:1790946667.079180:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946667.083505:0:14480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286607360 00000100:00100000:3.0:1790946667.083526:0:14480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286607360 00000100:00100000:3.0:1790946667.085801:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 93 00000100:00100000:3.0:1790946667.085841:0:14480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146987c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:297779ff-2cb2-4723-b8d5-25521c7fc733+11:13886:x1877943286607360:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790946667.086514:0:14480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146987c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:297779ff-2cb2-4723-b8d5-25521c7fc733+11:13886:x1877943286607360:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 687us (7346us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946667.086538:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 93 00000100:00100000:1.0:1790946667.098733:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946667.099019:0:14478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286607488 00000100:00100000:3.0:1790946667.099034:0:14478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286607488 00000100:00100000:3.0:1790946667.099105:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 94 00000100:00100000:3.0:1790946667.099116:0:14478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beda0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:297779ff-2cb2-4723-b8d5-25521c7fc733+11:13886:x1877943286607488:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790946667.099960:0:14478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beda0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:297779ff-2cb2-4723-b8d5-25521c7fc733+11:13886:x1877943286607488:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 841us (1237us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946667.099970:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 94 00000100:00100000:1.0:1790946667.106787:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946667.107306:0:14480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286607616 00000100:00100000:3.0:1790946667.107320:0:14480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286607616 00000100:00100000:3.0:1790946667.107706:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 95 00000100:00100000:3.0:1790946667.107719:0:14480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beda0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:297779ff-2cb2-4723-b8d5-25521c7fc733+11:13880:x1877943286607616:12345-192.168.203.13@tcp:101:mount.lustre.0 00010000:00010000:3.0:1790946667.107742:0:14480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946667.107777:0:14480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9146be9f6600/0x16e41aef9327306a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x826f92adbe0d0c6 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946667.107832:0:14480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9146be9f6600/0x16e41aef9327306a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d0c6 expref: 12 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946667.107845:0:14480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9146be9f6600/0x16e41aef9327306a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d0c6 expref: 12 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946667.107856:0:14480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146be9f6600, rc 0) 00000100:00100000:3.0:1790946667.107939:0:14480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beda0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:297779ff-2cb2-4723-b8d5-25521c7fc733+12:13880:x1877943286607616:12345-192.168.203.13@tcp:101:mount.lustre.0 Request processed in 223us (1167us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946667.107952:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 95 00000100:00100000:1.0:1790946667.117186:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946667.117464:0:14478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286607744 00000100:00100000:3.0:1790946667.117542:0:14478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286607744 00000100:00100000:3.0:1790946667.117926:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 96 00000100:00100000:3.0:1790946667.117937:0:14478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beda1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:297779ff-2cb2-4723-b8d5-25521c7fc733+12:13880:x1877943286607744:12345-192.168.203.13@tcp:256:mount.lustre.0 20000000:01000000:3.0:1790946667.117964:0:14478:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1790946667.117986:0:14478:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1790946667.117990:0:14478:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1790946667.117993:0:14478:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1790946667.117995:0:14478:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1790946667.121578:0:14478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beda1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:297779ff-2cb2-4723-b8d5-25521c7fc733+12:13880:x1877943286607744:12345-192.168.203.13@tcp:256:mount.lustre.0 Request processed in 3633us (4392us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946667.121593:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 96 00000100:00100000:1.0:1790946667.128049:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946667.128167:0:14480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286607872 00000100:00100000:3.0:1790946667.128177:0:14480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286607872 00000100:00100000:3.0:1790946667.128597:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 97 00000100:00100000:3.0:1790946667.128609:0:14480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beda2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:297779ff-2cb2-4723-b8d5-25521c7fc733+12:13880:x1877943286607872:12345-192.168.203.13@tcp:101:mount.lustre.0 00010000:00010000:3.0:1790946667.128627:0:14480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946667.128646:0:14480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9146be9f6c00/0x16e41aef93273071 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x826f92adbe0d0cd expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946667.128676:0:14480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9146be9f6c00/0x16e41aef93273071 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d0cd expref: 13 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946667.128687:0:14480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9146be9f6c00/0x16e41aef93273071 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d0cd expref: 13 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946667.128696:0:14480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146be9f6c00, rc 0) 00000100:00100000:3.0:1790946667.128759:0:14480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beda2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:297779ff-2cb2-4723-b8d5-25521c7fc733+13:13880:x1877943286607872:12345-192.168.203.13@tcp:101:mount.lustre.0 Request processed in 153us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946667.128780:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 97 00000100:00100000:1.0:1790946667.133065:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946667.133325:0:14478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286608000 00000100:00100000:3.0:1790946667.133340:0:14478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286608000 00000100:00100000:2.0:1790946667.133761:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 98 00000100:00100000:2.0:1790946667.133773:0:14478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beda2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:297779ff-2cb2-4723-b8d5-25521c7fc733+13:13880:x1877943286608000:12345-192.168.203.13@tcp:501:mount.lustre.0 00000100:00100000:2.0:1790946667.134195:0:14478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beda2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:297779ff-2cb2-4723-b8d5-25521c7fc733+13:13880:x1877943286608000:12345-192.168.203.13@tcp:501:mount.lustre.0 Request processed in 421us (1144us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946667.134233:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 98 00000100:00100000:1.0:1790946667.137608:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946667.137705:0:14480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286608128 00000100:00100000:3.0:1790946667.137719:0:14480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286608128 00000100:00100000:3.0:1790946667.137782:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 99 00000100:00100000:3.0:1790946667.137794:0:14480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beda2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:297779ff-2cb2-4723-b8d5-25521c7fc733+13:13880:x1877943286608128:12345-192.168.203.13@tcp:503:mount.lustre.0 00000100:00100000:3.0:1790946667.138117:0:14480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beda2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:297779ff-2cb2-4723-b8d5-25521c7fc733+13:13880:x1877943286608128:12345-192.168.203.13@tcp:503:mount.lustre.0 Request processed in 324us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946667.138126:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 99 00000100:00100000:1.0:1790946667.144384:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946667.144525:0:14480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286608256 00000100:00100000:3.0:1790946667.144539:0:14480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286608256 00000100:00100000:3.0:1790946667.144604:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 100 00000100:00100000:3.0:1790946667.144617:0:14480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beda3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:297779ff-2cb2-4723-b8d5-25521c7fc733+13:13889:x1877943286608256:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790946667.146151:0:14480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beda3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:297779ff-2cb2-4723-b8d5-25521c7fc733+13:13889:x1877943286608256:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 1524us (1770us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946667.146166:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 100 00000100:00100000:1.0:1790946667.154619:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946667.154837:0:14481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286608384 00000100:00100000:0.0:1790946667.155634:0:14481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286608384 00000100:00100000:0.0:1790946667.155725:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 101 00000100:00100000:0.0:1790946667.155737:0:14481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beda1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:297779ff-2cb2-4723-b8d5-25521c7fc733+13:13889:x1877943286608384:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790946667.158390:0:14481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beda1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:297779ff-2cb2-4723-b8d5-25521c7fc733+13:13889:x1877943286608384:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 2637us (3768us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946667.158406:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 101 00000100:00100000:1.0:1790946667.176796:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946667.177356:0:14487:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286608512 00000100:00100000:2.0:1790946667.177371:0:14487:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286608512 00000100:00100000:2.0:1790946667.177439:0:14487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:2.0:1790946667.177450:0:14487:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468e93c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2360:x1877943286608512:12345-192.168.203.13@tcp:38:mount.lustre.0 00010000:00080000:2.0:1790946667.177702:0:14487:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from d8c7f7a5-9948-489b-83db-1b4a989e21d4@192.168.203.13@tcp t0 exp 0000000000000000 cur 452 last 0 00000020:00000080:2.0:1790946667.177754:0:14487:0:(genops.c:1384:class_connect()) connect: client d8c7f7a5-9948-489b-83db-1b4a989e21d4, cookie 0x16e41aef93273078 00000004:00100000:2.0:1790946667.177801:0:14487:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:2.0:1790946667.182491:0:14487:0:(import.c:65:import_set_state_nolock()) ffff9146b665f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790946667.185107:0:14487:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468e93c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8c7f7a5-9948-489b-83db-1b4a989e21d4+6:2360:x1877943286608512:12345-192.168.203.13@tcp:38:mount.lustre.0 Request processed in 7640us (8311us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946667.185147:0:14487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:1.0:1790946667.188874:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946667.189050:0:16113:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286608768 00000100:00100000:0.0:1790946667.189064:0:16113:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286608768 00000100:00100000:0.0:1790946667.189159:0:16113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:0.0:1790946667.189175:0:16113:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91468e93ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8c7f7a5-9948-489b-83db-1b4a989e21d4+6:13880:x1877943286608768:12345-192.168.203.13@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790946667.189292:0:16113:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:2.0:1790946667.189410:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790946667.189892:0:16113:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91468e93ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8c7f7a5-9948-489b-83db-1b4a989e21d4+6:13880:x1877943286608768:12345-192.168.203.13@tcp:41:mount.lustre.0 Request processed in 719us (1039us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946667.189911:0:16113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:1.0:1790946667.190102:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946667.192311:0:14486:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286608640 00000100:00100000:0.0:1790946667.192352:0:14486:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286608640 00000100:00100000:0.0:1790946667.192443:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:0.0:1790946667.192454:0:14486:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8c7f7a5-9948-489b-83db-1b4a989e21d4+6:0:x1877943286608640:12345-192.168.203.13@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790946667.192767:0:14486:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1790946667.193179:0:14486:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8c7f7a5-9948-489b-83db-1b4a989e21d4+6:0:x1877943286608640:12345-192.168.203.13@tcp:41:mount.lustre.0 Request processed in 722us (3073us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946667.193189:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:1.0:1790946667.199335:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946667.199430:0:14488:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286608896 00000100:00100000:3.0:1790946667.199444:0:14488:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286608896 00000100:00100000:3.0:1790946667.199533:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:3.0:1790946667.199547:0:14488:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8c7f7a5-9948-489b-83db-1b4a989e21d4+6:13880:x1877943286608896:12345-192.168.203.13@tcp:40:mount.lustre.0 00000100:00100000:3.0:1790946667.199682:0:14488:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8c7f7a5-9948-489b-83db-1b4a989e21d4+6:13880:x1877943286608896:12345-192.168.203.13@tcp:40:mount.lustre.0 Request processed in 138us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946667.199691:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:2.0:1790946667.206066:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946667.206187:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946667.206324:0:15171:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286609024 00000100:00100000:0.0:1790946667.206337:0:15171:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286609024 00000100:00100000:0.0:1790946667.206423:0:15171:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286609152 00000100:00100000:0.0:1790946667.206427:0:15171:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286609152 00000100:00100000:2.0:1790946667.206476:0:15168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:2.0:1790946667.206487:0:15168:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5a6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2360:x1877943286609024:12345-192.168.203.13@tcp:8:mount.lustre.0 00010000:00080000:2.0:1790946667.206531:0:15168:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from d8c7f7a5-9948-489b-83db-1b4a989e21d4@192.168.203.13@tcp t0 exp 0000000000000000 cur 452 last 0 00000020:00000080:2.0:1790946667.206574:0:15168:0:(genops.c:1384:class_connect()) connect: client d8c7f7a5-9948-489b-83db-1b4a989e21d4, cookie 0x16e41aef9327307f 00002000:00100000:2.0:1790946667.206590:0:15168:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d8c7f7a5-9948-489b-83db-1b4a989e21d4/ffff9146b6658800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790946667.206603:0:15168:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:2.0:1790946667.207080:0:15168:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1790946667.207124:0:15168:0:(import.c:65:import_set_state_nolock()) ffff9146b665c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790946667.207261:0:15168:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5a6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d8c7f7a5-9948-489b-83db-1b4a989e21d4+6:2360:x1877943286609024:12345-192.168.203.13@tcp:8:mount.lustre.0 Request processed in 772us (1208us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946667.207271:0:15168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:2.0:1790946667.207299:0:15168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:2.0:1790946667.207304:0:15168:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5a68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2360:x1877943286609152:12345-192.168.203.13@tcp:8:mount.lustre.0 00010000:00080000:2.0:1790946667.207328:0:15168:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from d8c7f7a5-9948-489b-83db-1b4a989e21d4@192.168.203.13@tcp t0 exp 0000000000000000 cur 452 last 0 00000020:00000080:2.0:1790946667.207356:0:15168:0:(genops.c:1384:class_connect()) connect: client d8c7f7a5-9948-489b-83db-1b4a989e21d4, cookie 0x16e41aef93273086 00002000:00100000:2.0:1790946667.207364:0:15168:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d8c7f7a5-9948-489b-83db-1b4a989e21d4/ffff9146b665b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790946667.207372:0:15168:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:2.0:1790946667.209231:0:15168:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790946667.209288:0:15168:0:(import.c:65:import_set_state_nolock()) ffff9146a0073800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790946667.209397:0:15168:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5a68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d8c7f7a5-9948-489b-83db-1b4a989e21d4+6:2360:x1877943286609152:12345-192.168.203.13@tcp:8:mount.lustre.0 Request processed in 2088us (3207us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946667.209409:0:15168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:2.0:1790946667.213740:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946667.214084:0:14490:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286609280 00000100:00100000:0.0:1790946667.214097:0:14490:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286609280 00000100:00100000:0.0:1790946667.214161:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 1 00000100:00100000:0.0:1790946667.214172:0:14490:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5a69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d8c7f7a5-9948-489b-83db-1b4a989e21d4+6:13880:x1877943286609280:12345-192.168.203.13@tcp:33:mount.lustre.0 00000004:00200000:0.0:1790946667.214369:0:14490:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1790946667.214771:0:14490:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5a69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d8c7f7a5-9948-489b-83db-1b4a989e21d4+6:13880:x1877943286609280:12345-192.168.203.13@tcp:33:mount.lustre.0 Request processed in 598us (1044us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946667.214782:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 1 00000100:00100000:1.0:1790946667.373629:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946667.373827:0:14487:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286609408 00000100:00100000:3.0:1790946667.373871:0:14487:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286609408 00000100:00100000:3.0:1790946667.373946:0:14487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:3.0:1790946667.373958:0:14487:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8c7f7a5-9948-489b-83db-1b4a989e21d4+6:13910:x1877943286609408:12345-192.168.203.13@tcp:101:mkdir.0 00010000:00010000:3.0:1790946667.373986:0:14487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946667.374016:0:14487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7e00/0x16e41aef9327308d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0d0f7 expref: -99 pid: 14487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946667.374118:0:14487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef93273094 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946667.374136:0:14487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef93273094 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946667.374151:0:14487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef93273094 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790946667.374195:0:14487:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790946667.374234:0:14487:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790946667.374264:0:14487:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef93273094 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946667.374295:0:14487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f7e00/0x16e41aef9327308d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d0f7 expref: 8 pid: 14487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946667.374593:0:14487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef93273094 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d0f7 expref: 7 pid: 14487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946667.374604:0:14487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff914683831700) 00010000:00010000:3.0:1790946667.374607:0:14487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790946667.374611:0:14487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146be9f6800, rc 0) 00000100:00100000:3.0:1790946667.375048:0:14487:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8c7f7a5-9948-489b-83db-1b4a989e21d4+7:13910:x1877943286609408:12345-192.168.203.13@tcp:101:mkdir.0 Request processed in 1090us (1432us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946667.375059:0:14487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 14 00010000:00010000:0.0:1790946667.696483:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790946668.016475:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790946668.016515:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be126680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303378816:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790946668.016745:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946668.019773:0:15172:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303378816 00000100:00100000:3.0:1790946668.019791:0:15172:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303378816 00000100:00100000:3.0:1790946668.019884:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790946668.019894:0:15172:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be98d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1877943303378816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790946668.019933:0:15172:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790946668.020019:0:15172:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be98d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1877943303378816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (3276us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946668.020027:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1790946668.020053:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790946668.020629:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be126680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303378816:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1790946668.091042:0:6700:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 367257b9-14b9-4792-8ebc-8eea5a9ade3a 00000001:00100000:3.0:1790946668.091063:0:6700:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d8c7f7a5-9948-489b-83db-1b4a989e21d4 00010000:00010000:0.0:1790946668.720370:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1790946669.649330:0:5857:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 367257b9-14b9-4792-8ebc-8eea5a9ade3a 00000001:00100000:0.0:1790946669.649344:0:5857:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d8c7f7a5-9948-489b-83db-1b4a989e21d4 00010000:00010000:0.0:1790946669.744443:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946670.069195:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:3301:1877943303378944:0@lo:400:kworker.0 00000100:00100000:3.0:1790946670.069323:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946670.069393:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1877943303379456:0@lo:400:kworker.0 00000100:00100000:3.0:1790946670.069425:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946670.069453:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790946670.069459:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1877943303379328:0@lo:400:kworker.0 00000100:00100000:3.0:1790946670.069481:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946670.069506:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303379072:0@lo:400:kworker.0 00000100:00100000:3.0:1790946670.069534:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946670.069550:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1877943303379584:0@lo:400:kworker.0 00000100:00100000:0.0:1790946670.069606:0:14488:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303379456 00000100:00100000:0.0:1790946670.069617:0:14488:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303379456 00000100:00100000:0.0:1790946670.069681:0:14488:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303379328 00000100:00100000:0.0:1790946670.069685:0:14488:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303379328 00000100:00100000:0.0:1790946670.069710:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790946670.069720:0:14488:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be126680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1877943303379456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946670.069801:0:14488:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be126680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1877943303379456:12345-0@lo:400:kworker.0 Request processed in 83us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946670.069810:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790946670.069830:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790946670.069837:0:14488:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be125c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1877943303379328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946670.069864:0:14488:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be125c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1877943303379328:12345-0@lo:400:kworker.0 Request processed in 29us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946670.069870:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1790946670.069889:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790946670.069928:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1877943303379328:0@lo:400:kworker.0 00000100:00100000:0.0:1790946670.069939:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1877943303379456:0@lo:400:kworker.0 00000100:00100000:3.0:1790946670.070101:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946670.070130:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1790946670.070136:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303379200:0@lo:400:kworker.0 00000100:00100000:3.0:1790946670.070162:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946670.070180:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914698016680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303379712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790946670.070223:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946670.070254:0:14480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303378944 00000100:00100000:3.0:1790946670.070258:0:14480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303378944 00000100:00100000:3.0:1790946670.070286:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1790946670.070293:0:14480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beda1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+19:3301:x1877943303378944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946670.070327:0:14480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beda1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+19:3301:x1877943303378944:12345-0@lo:400:kworker.0 Request processed in 35us (1005us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946670.070333:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1790946670.070687:0:15168:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303379072 00000100:00100000:2.0:1790946670.070692:0:15168:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303379072 00000100:00100000:2.0:1790946670.070733:0:15168:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303379200 00000100:00100000:2.0:1790946670.070736:0:15168:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303379200 00000100:00100000:2.0:1790946670.070753:0:15168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790946670.070760:0:15168:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be124380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303379072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946670.070819:0:15168:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be124380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303379072:12345-0@lo:400:kworker.0 Request processed in 59us (1284us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946670.070826:0:15168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790946670.070840:0:15168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790946670.070846:0:15168:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be127800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303379200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946670.070874:0:15168:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be127800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303379200:12345-0@lo:400:kworker.0 Request processed in 28us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946670.070881:0:15168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1790946670.070901:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790946670.070904:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790946670.070929:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1790946670.070945:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303379200:0@lo:400:kworker.0 00000100:00100000:2.0:1790946670.070957:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303379072:0@lo:400:kworker.0 00000100:00100000:0.0:1790946670.071610:0:14488:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303379584 00000100:00100000:0.0:1790946670.071618:0:14488:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303379584 00000100:00100000:0.0:1790946670.071673:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790946670.071681:0:14488:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be124000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877943303379584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946670.071737:0:14488:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be124000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877943303379584:12345-0@lo:400:kworker.0 Request processed in 58us (2153us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946670.071743:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790946670.071774:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:3301:1877943303378944:0@lo:400:kworker.0 00000100:00080000:2.0:1790946670.072053:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790946670.072083:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1877943303379584:0@lo:400:kworker.0 00000100:00100000:3.0:1790946670.074340:0:15172:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303379712 00000100:00100000:3.0:1790946670.074359:0:15172:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303379712 00000100:00100000:3.0:1790946670.074427:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790946670.074438:0:15172:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be124e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303379712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790946670.074485:0:15172:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790946670.074590:0:15172:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be124e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303379712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 153us (4387us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946670.074598:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790946670.075319:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914698016680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303379712:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1790946670.133496:0:7645:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d8c7f7a5-9948-489b-83db-1b4a989e21d4 00000001:02000400:2.0:1790946670.326949:0:16452:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1790946670.771865:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790946671.792433:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946672.353514:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946672.353579:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946672.353628:0:14481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286609536 00000100:00100000:1.0:1790946672.353641:0:14481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286609536 00000100:00100000:1.0:1790946672.353712:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 103 00000100:00100000:1.0:1790946672.353724:0:14481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beda1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:297779ff-2cb2-4723-b8d5-25521c7fc733+13:2364:x1877943286609536:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790946672.353837:0:14481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beda1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:297779ff-2cb2-4723-b8d5-25521c7fc733+13:2364:x1877943286609536:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 114us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946672.353845:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 103 00000100:00100000:0.0:1790946672.354182:0:14486:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286609664 00000100:00100000:0.0:1790946672.354189:0:14486:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286609664 00000100:00100000:0.0:1790946672.354273:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:0.0:1790946672.354282:0:14486:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:367257b9-14b9-4792-8ebc-8eea5a9ade3a+6:2363:x1877943286609664:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1790946672.354329:0:14486:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:367257b9-14b9-4792-8ebc-8eea5a9ade3a+6:2363:x1877943286609664:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 49us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946672.354335:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00080000:1.0:1790946672.354813:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790946672.379382:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946672.379419:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946672.379446:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946672.379491:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946672.379533:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946672.380300:0:15168:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286609920 00000100:00100000:2.0:1790946672.380315:0:15168:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286609920 00000100:00100000:2.0:1790946672.380391:0:15168:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286610176 00000100:00100000:2.0:1790946672.380395:0:15168:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286610176 00000100:00100000:2.0:1790946672.380411:0:15168:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286609792 00000100:00100000:2.0:1790946672.380414:0:15168:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286609792 00000100:00100000:2.0:1790946672.380425:0:15168:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286610304 00000100:00100000:2.0:1790946672.380427:0:15168:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286610304 00000100:00100000:2.0:1790946672.380459:0:15168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:2.0:1790946672.380470:0:15168:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:367257b9-14b9-4792-8ebc-8eea5a9ade3a+5:2363:x1877943286609920:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790946672.380576:0:15168:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:367257b9-14b9-4792-8ebc-8eea5a9ade3a+5:2363:x1877943286609920:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 107us (1209us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946672.380586:0:15168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:2.0:1790946672.380607:0:15168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:2.0:1790946672.380614:0:15168:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d8c7f7a5-9948-489b-83db-1b4a989e21d4+5:2363:x1877943286610176:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790946672.380644:0:15168:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d8c7f7a5-9948-489b-83db-1b4a989e21d4+5:2363:x1877943286610176:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 30us (1224us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946672.380651:0:15168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:2.0:1790946672.380663:0:15168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:2.0:1790946672.380669:0:15168:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:367257b9-14b9-4792-8ebc-8eea5a9ade3a+5:2364:x1877943286609792:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790946672.380691:0:15168:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:367257b9-14b9-4792-8ebc-8eea5a9ade3a+5:2364:x1877943286609792:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 23us (1245us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946672.380697:0:15168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:2.0:1790946672.380707:0:15168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:2.0:1790946672.380713:0:15168:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d8c7f7a5-9948-489b-83db-1b4a989e21d4+5:2364:x1877943286610304:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790946672.380735:0:15168:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d8c7f7a5-9948-489b-83db-1b4a989e21d4+5:2364:x1877943286610304:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 22us (1201us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946672.380757:0:15168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00080000:1.0:1790946672.381949:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790946672.381961:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790946672.382217:0:14488:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286610048 00000100:00100000:0.0:1790946672.382231:0:14488:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286610048 00000100:00080000:1.0:1790946672.382463:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790946672.383552:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:0.0:1790946672.383569:0:14488:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8c7f7a5-9948-489b-83db-1b4a989e21d4+6:2364:x1877943286610048:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1790946672.383695:0:14488:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8c7f7a5-9948-489b-83db-1b4a989e21d4+6:2364:x1877943286610048:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 131us (4201us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946672.383704:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 20 00010000:00010000:0.0:1790946672.816686:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946673.136424:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be127b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303379840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790946673.136492:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946673.136568:0:15172:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303379840 00000100:00100000:3.0:1790946673.136576:0:15172:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303379840 00000100:00100000:3.0:1790946673.136625:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790946673.136634:0:15172:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be124700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303379840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790946673.136670:0:15172:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790946673.136713:0:15172:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be124700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303379840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946673.136720:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1790946673.136740:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790946673.137038:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be127b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303379840:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790946673.847875:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1790946674.050574:0:16599:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe783e0890 20000000:00000080:0.0:1790946674.050590:0:16599:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9146a0c3f400 uarg=0000000000000000 20000000:01000000:0.0:1790946674.050627:0:16599:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1790946674.050632:0:16599:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1790946674.050636:0:16599:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1790946674.052000:0:16600:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1790946674.052606:0:16599:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1790946674.075353:0:16599:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1790946674.075439:0:16599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9146b1933400/0x16e41aef9327309b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946674.075459:0:16599:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9146b180ee00/0x16e41aef93272d92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93272d8b expref: 18 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946674.075487:0:16599:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9146b1932800/0x16e41aef93272ddf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93272dd8 expref: 18 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946674.075494:0:16599:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9146b1933200/0x16e41aef93272f1a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef93272f13 expref: 18 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946674.075503:0:16599:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff914680031a00/0x16e41aef93273039 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d06b expref: 12 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946674.075511:0:16599:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9146be9f6c00/0x16e41aef93273071 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d0cd expref: 12 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946674.075519:0:16599:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9146b1933400/0x16e41aef9327309b lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946674.075561:0:16599:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9146be9f6c00/0x16e41aef93273071 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d0cd expref: 12 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946674.075577:0:16599:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9146be9f6c00/0x16e41aef93273071 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d0cd expref: 12 pid: 14480 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946674.075593:0:16599:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914698014380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16599:1877943303379968:192.168.203.13@tcp:104: 00010000:00010000:0.0:1790946674.075699:0:16599:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff914680031a00/0x16e41aef93273039 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d06b expref: 12 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946674.075706:0:16599:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff914680031a00/0x16e41aef93273039 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d06b expref: 12 pid: 14478 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946674.075714:0:16599:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914698017800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16599:1877943303380096:192.168.203.13@tcp:104: 00010000:00010000:0.0:1790946674.075750:0:16599:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9146b1933200/0x16e41aef93272f1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x16e41aef93272f13 expref: 18 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946674.075770:0:16599:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9146b1933200/0x16e41aef93272f1a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x16e41aef93272f13 expref: 18 pid: 14481 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946674.075779:0:16599:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914698014000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16599:1877943303380224:0@lo:104: 00000100:00100000:0.0:1790946674.075817:0:16599:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790946674.075908:0:16599:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9146b1932800/0x16e41aef93272ddf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x16e41aef93272dd8 expref: 18 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946674.075917:0:16599:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9146b1932800/0x16e41aef93272ddf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x16e41aef93272dd8 expref: 18 pid: 14478 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946674.075924:0:16599:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914698016680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16599:1877943303380352:0@lo:104: 00000100:00100000:0.0:1790946674.075947:0:16599:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790946674.076812:0:16599:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9146b180ee00/0x16e41aef93272d92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x16e41aef93272d8b expref: 18 pid: 14478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946674.076825:0:16599:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9146b180ee00/0x16e41aef93272d92 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x16e41aef93272d8b expref: 18 pid: 14478 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946674.076834:0:16599:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91469829c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16599:1877943303380480:0@lo:104: 00000100:00100000:0.0:1790946674.076868:0:16599:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946674.076941:0:14469:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303380224 00000100:00100000:2.0:1790946674.076949:0:14469:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303380224 00000100:00100000:2.0:1790946674.076984:0:14469:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303380352 00000100:00100000:2.0:1790946674.076987:0:14469:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303380352 00000100:00100000:2.0:1790946674.076999:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790946674.077007:0:14469:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914698017100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+4:16599:x1877943303380224:12345-0@lo:104: 00010000:00010000:2.0:1790946674.077021:0:14469:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff914680031c00/0x16e41aef93272f13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93272f1a expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946674.077074:0:14469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790946674.077081:0:14469:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914698017100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+4:16599:x1877943303380224:12345-0@lo:104: Request processed in 74us (1264us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946674.077088:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790946674.077111:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790946674.077118:0:14469:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91469829ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+3:16599:x1877943303380352:12345-0@lo:104: 00010000:00010000:2.0:1790946674.077136:0:14469:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9146be9f6e00/0x16e41aef93272dd8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93272ddf expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946674.077172:0:14469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790946674.077177:0:14469:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91469829ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+3:16599:x1877943303380352:12345-0@lo:104: Request processed in 60us (1230us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946674.077183:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1790946674.077218:0:14475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790946674.077224:0:14475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff914680031c00/0x16e41aef93272f13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93272f1a expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946674.077231:0:14475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914680031c00 already unused, calling callback (ffffffffc1d96c20) 10000000:00010000:2.0:1790946674.077245:0:14475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff914680031c00/0x16e41aef93272f13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x16e41aef93272f1a expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946674.077253:0:14475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff914680031c00/0x16e41aef93272f13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x16e41aef93272f1a expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790946674.077380:0:14475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff914680031c00/0x16e41aef93272f13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x16e41aef93272f1a expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790946674.077388:0:14475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790946674.077429:0:14475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff914680031c00/0x16e41aef93272f13 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93272f1a expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946674.077435:0:14475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790946674.077455:0:14475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff914680031c00/0x16e41aef93272f13 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93272f1a expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946674.077462:0:14475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff914680031c00/0x16e41aef93272f13 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93272f1a expref: -99 pid: 15886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946674.077476:0:14475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946674.077480:0:14475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9146be9f6e00/0x16e41aef93272dd8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93272ddf expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946674.077486:0:14475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146be9f6e00 already unused, calling callback (ffffffffc1d96c20) 10000000:00010000:2.0:1790946674.077488:0:14475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9146be9f6e00/0x16e41aef93272dd8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x16e41aef93272ddf expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946674.077494:0:14475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9146be9f6e00/0x16e41aef93272dd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x16e41aef93272ddf expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790946674.077513:0:14475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9146be9f6e00/0x16e41aef93272dd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x16e41aef93272ddf expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790946674.077518:0:14475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790946674.077532:0:14475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9146be9f6e00/0x16e41aef93272dd8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93272ddf expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946674.077538:0:14475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790946674.077565:0:14475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9146be9f6e00/0x16e41aef93272dd8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93272ddf expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946674.077572:0:14475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9146be9f6e00/0x16e41aef93272dd8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93272ddf expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946674.077583:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946674.077585:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946674.077586:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946674.077593:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946674.077607:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790946674.077618:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5a6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:3303:1877943303380736:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790946674.077651:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946674.077681:0:14471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303380736 00000100:00100000:2.0:1790946674.077686:0:14471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303380736 00010000:00010000:2.0:1790946674.077705:0:14471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9146b1932800/0x16e41aef93272ddf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef93272dd8 expref: 19 pid: 14478 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946674.077727:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790946674.077734:0:14471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5a6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+19:3303:x1877943303380736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790946674.077744:0:14471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790946674.077766:0:14471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9146b1932800/0x16e41aef93272ddf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef93272dd8 expref: 19 pid: 14478 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946674.077774:0:14471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9146b1932800/0x16e41aef93272ddf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x16e41aef93272dd8 expref: 19 pid: 14478 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946674.077791:0:14471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790946674.077819:0:14471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5a6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+19:3303:x1877943303380736:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946674.077826:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790946674.077863:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5a6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:3303:1877943303380736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790946674.079355:0:16599:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146a334cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1790946674.079388:0:16599:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914698014000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16599:1877943303380224:0@lo:104: 00010000:00010000:0.0:1790946674.079399:0:16599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9146b1932800/0x16e41aef93272ddf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x16e41aef93272dd8 expref: 18 pid: 14478 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946674.079525:0:16599:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914698016680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16599:1877943303380352:0@lo:104: 00000100:00100000:2.0:1790946674.079675:0:14469:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1790946674.079691:0:14469:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303380480 00000100:00100000:2.0:1790946674.079697:0:14469:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303380480 00000100:00100000:2.0:1790946674.079733:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790946674.079741:0:14469:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b695c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+3:16599:x1877943303380480:12345-0@lo:104: 00010000:00010000:2.0:1790946674.079764:0:14469:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff914688aef200/0x16e41aef93272d8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93272d92 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946674.079849:0:14469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790946674.079855:0:14469:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b695c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+3:16599:x1877943303380480:12345-0@lo:104: Request processed in 115us (2987us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946674.079861:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1790946674.079902:0:14475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946674.079909:0:14475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff914688aef200/0x16e41aef93272d8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x16e41aef93272d92 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946674.079918:0:14475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aef200 already unused, calling callback (ffffffffc1d96c20) 10000000:00010000:2.0:1790946674.079921:0:14475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff914688aef200/0x16e41aef93272d8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x16e41aef93272d92 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946674.079937:0:14475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff914688aef200/0x16e41aef93272d8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x16e41aef93272d92 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790946674.079944:0:14475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff914688aef200/0x16e41aef93272d8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x16e41aef93272d92 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790946674.079950:0:14475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790946674.079979:0:14475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff914688aef200/0x16e41aef93272d8b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93272d92 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946674.079986:0:14475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790946674.080001:0:14475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff914688aef200/0x16e41aef93272d8b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93272d92 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946674.080008:0:14475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff914688aef200/0x16e41aef93272d8b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x16e41aef93272d92 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946674.080023:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946674.080024:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946674.080026:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946674.080044:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5a6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:3303:1877943303380864:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790946674.080078:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946674.080113:0:14473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303380864 00000100:00100000:2.0:1790946674.080118:0:14473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303380864 00000100:00100000:3.0:1790946674.080397:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5a68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:3301:1877943303380608:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790946674.080536:0:14473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9146b180ee00/0x16e41aef93272d92 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef93272d8b expref: 18 pid: 14478 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946674.080621:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790946674.080630:0:14473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5a6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+18:3303:x1877943303380864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790946674.080651:0:14473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790946674.080656:0:14473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9146b180ee00/0x16e41aef93272d92 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef93272d8b expref: 18 pid: 14478 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946674.080666:0:14473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9146b180ee00/0x16e41aef93272d92 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x16e41aef93272d8b expref: 18 pid: 14478 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946674.080681:0:14473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790946674.080716:0:14473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5a6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+18:3303:x1877943303380864:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946674.080723:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790946674.080769:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5a6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:3303:1877943303380864:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790946674.080847:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790946674.081021:0:16599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9146b180ee00/0x16e41aef93272d92 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x16e41aef93272d8b expref: 17 pid: 14478 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946674.081035:0:16599:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91469829c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16599:1877943303380480:0@lo:104: 00000100:00100000:2.0:1790946674.081115:0:14472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303380608 00000100:00100000:2.0:1790946674.081121:0:14472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303380608 00010000:00010000:2.0:1790946674.081235:0:14472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9146b1933200/0x16e41aef93272f1a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef93272f13 expref: 17 pid: 14481 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946674.081362:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790946674.081370:0:14473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914584abc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+17:3301:x1877943303380608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790946674.081381:0:14473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790946674.081385:0:14473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9146b1933200/0x16e41aef93272f1a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x16e41aef93272f13 expref: 17 pid: 14481 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946674.081394:0:14473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9146b1933200/0x16e41aef93272f1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x16e41aef93272f13 expref: 17 pid: 14481 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946674.081416:0:14473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9146b1933200/0x16e41aef93272f1a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x16e41aef93272f13 expref: 17 pid: 14481 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946674.081426:0:14473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790946674.081463:0:14473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914584abc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+16:3301:x1877943303380608:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946674.081470:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790946674.081958:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5a68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:3301:1877943303380608:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790946674.089381:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946674.089424:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946674.089713:0:14471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286610432 00000100:00100000:3.0:1790946674.089723:0:14471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286610432 00010000:00010000:3.0:1790946674.089768:0:14471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9146be9f6c00/0x16e41aef93273071 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d0cd expref: 13 pid: 14480 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946674.089803:0:14471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286610560 00000100:00100000:3.0:1790946674.089807:0:14471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286610560 00010000:00010000:3.0:1790946674.089820:0:14471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff914680031a00/0x16e41aef93273039 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d06b expref: 14 pid: 14478 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946674.089835:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:3.0:1790946674.089845:0:14471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5a6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:297779ff-2cb2-4723-b8d5-25521c7fc733+14:2363:x1877943286610432:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790946674.089859:0:14471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790946674.089863:0:14471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9146be9f6c00/0x16e41aef93273071 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d0cd expref: 14 pid: 14480 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946674.089876:0:14471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9146be9f6c00/0x16e41aef93273071 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d0cd expref: 14 pid: 14480 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946674.089895:0:14471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790946674.089955:0:14471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5a6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:297779ff-2cb2-4723-b8d5-25521c7fc733+14:2363:x1877943286610432:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 112us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946674.089962:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:3.0:1790946674.089979:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:3.0:1790946674.089986:0:14471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5a68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:297779ff-2cb2-4723-b8d5-25521c7fc733+13:2363:x1877943286610560:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790946674.089994:0:14471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790946674.089998:0:14471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff914680031a00/0x16e41aef93273039 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d06b expref: 13 pid: 14478 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946674.090028:0:14471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff914680031a00/0x16e41aef93273039 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d06b expref: 13 pid: 14478 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946674.090041:0:14471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9146b1933400/0x16e41aef9327309b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946674.090049:0:14471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9146b1933400/0x16e41aef9327309b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946674.090064:0:16599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9146be9f6c00/0x16e41aef93273071 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d0cd expref: 13 pid: 14480 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946674.090065:0:14471:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9146b1933400/0x16e41aef9327309b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946674.090084:0:14471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9146b1933400/0x16e41aef9327309b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946674.090091:0:16599:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914698014380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16599:1877943303379968:192.168.203.13@tcp:104: 00010000:00010000:3.0:1790946674.090092:0:14471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9146b1933400/0x16e41aef9327309b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946674.090104:0:14471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9146b1933400/0x16e41aef9327309b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946674.090110:0:14471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1933400 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:3.0:1790946674.090116:0:14471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9146b1933400/0x16e41aef9327309b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946674.090120:0:16599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff914680031a00/0x16e41aef93273039 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d06b expref: 12 pid: 14478 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946674.090129:0:14471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9146b1933400/0x16e41aef9327309b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946674.090138:0:14471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9146b1933400/0x16e41aef9327309b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946674.090156:0:14471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790946674.090177:0:14471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5a68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:297779ff-2cb2-4723-b8d5-25521c7fc733+12:2363:x1877943286610560:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 191us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946674.090184:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:0.0:1790946674.090223:0:16599:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914698017800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16599:1877943303380096:192.168.203.13@tcp:104: 00010000:00010000:0.0:1790946674.090330:0:16599:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9146b1933400/0x16e41aef9327309b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946674.090341:0:16599:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9146b1933400/0x16e41aef9327309b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946674.090347:0:16599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9146b1933400/0x16e41aef9327309b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946674.090353:0:16599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9146b1933400/0x16e41aef9327309b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790946674.418621:0:14517:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790946674.864499:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790946675.184476:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5a6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303381248:0@lo:400:kworker.0 00000100:00100000:1.0:1790946675.184490:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5a68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303381120:0@lo:400:kworker.0 00000100:00100000:0.0:1790946675.184561:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5a6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:3300:1877943303380992:0@lo:400:kworker.0 00000100:00100000:2.0:1790946675.184860:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946675.185098:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790946675.185105:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5a68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877943303381376:0@lo:400:kworker.0 00000100:00100000:2.0:1790946675.185132:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946675.185167:0:14486:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303381376 00000100:00100000:2.0:1790946675.185175:0:14486:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303381376 00000100:00100000:2.0:1790946675.185240:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790946675.185265:0:14486:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be98ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877943303381376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790946675.185329:0:14486:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be98ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1877943303381376:12345-0@lo:400:kworker.0 Request processed in 65us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946675.185336:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790946675.185636:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5a68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1877943303381376:0@lo:400:kworker.0 00000100:00100000:1.0:1790946675.186389:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946675.189653:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5a6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1877943303381632:0@lo:400:kworker.0 00000100:00100000:1.0:1790946675.189715:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946675.189764:0:15168:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303381248 00000100:00100000:3.0:1790946675.189773:0:15168:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303381248 00000100:00100000:3.0:1790946675.189822:0:15168:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303381120 00000100:00100000:3.0:1790946675.189826:0:15168:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303381120 00000100:00100000:1.0:1790946675.189880:0:15171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790946675.189890:0:15171:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be98c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303381248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946675.190076:0:15171:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be98c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303381248:12345-0@lo:400:kworker.0 Request processed in 188us (5216us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946675.192514:0:15168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790946675.192540:0:15168:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1877943303381120:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1790946675.192760:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790946675.192766:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790946675.192869:0:15168:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1877943303381120:12345-0@lo:400:kworker.0 Request processed in 341us (6479us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946675.192878:0:15171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790946675.192937:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5a68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303381120:0@lo:400:kworker.0 00000100:00100000:1.0:1790946675.192980:0:16113:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303381632 00000100:00100000:1.0:1790946675.192988:0:16113:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303381632 00000100:00100000:1.0:1790946675.193049:0:16113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790946675.193057:0:16113:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1877943303381632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946675.193651:0:16113:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1877943303381632:12345-0@lo:400:kworker.0 Request processed in 593us (3934us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946675.193659:0:16113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1790946675.194403:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790946675.194439:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5a6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1877943303381632:0@lo:400:kworker.0 00000100:00100000:2.0:1790946675.194830:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790946675.194879:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946675.194913:0:14478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303380992 00000100:00100000:0.0:1790946675.194933:0:14478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303380992 00000100:00100000:0.0:1790946675.194972:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1790946675.194980:0:14478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bc850450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+16:3300:x1877943303380992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946675.195025:0:14478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bc850450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+16:3300:x1877943303380992:12345-0@lo:400:kworker.0 Request processed in 46us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946675.195032:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1790946675.195084:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5a6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:3300:1877943303380992:0@lo:400:kworker.0 00000100:00100000:0.0:1790946675.195093:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5a6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1877943303381504:0@lo:400:kworker.0 00000100:00100000:0.0:1790946675.195123:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946675.195145:0:14486:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303381504 00000100:00100000:0.0:1790946675.195149:0:14486:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303381504 00000100:00100000:0.0:1790946675.195197:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790946675.195220:0:14486:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91469829f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1877943303381504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946675.195252:0:14486:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91469829f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1877943303381504:12345-0@lo:400:kworker.0 Request processed in 33us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946675.195258:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1790946675.195273:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790946675.195290:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5a6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1877943303381504:0@lo:400:kworker.0 00000100:00100000:1.0:1790946675.196769:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5a6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303381248:0@lo:400:kworker.0 00000100:00100000:3.0:1790946675.198682:0:15168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790946675.199096:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91469829c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303381760:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790946675.199165:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946675.199608:0:15172:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303381760 00000100:00100000:3.0:1790946675.199617:0:15172:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303381760 00000100:00100000:3.0:1790946675.199671:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790946675.199681:0:15172:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5a6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877943303381760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790946675.199724:0:15172:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790946675.199795:0:15172:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5a6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877943303381760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946675.199802:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790946675.199844:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91469829c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303381760:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790946675.556501:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946675.560590:0:14480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286610688 00000100:00100000:3.0:1790946675.560605:0:14480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286610688 00000100:00100000:3.0:1790946675.560669:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 105 00000100:00100000:3.0:1790946675.560679:0:14480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bc850c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:297779ff-2cb2-4723-b8d5-25521c7fc733+11:13763:x1877943286610688:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790946675.560707:0:14480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946675.560727:0:14480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9146be9f7800/0x16e41aef932730a2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x826f92adbe0d0fe expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946675.560765:0:14480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9146be9f7800/0x16e41aef932730a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d0fe expref: 12 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946675.560776:0:14480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9146be9f7800/0x16e41aef932730a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d0fe expref: 12 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946675.560785:0:14480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146be9f7800, rc 0) 00000100:00100000:3.0:1790946675.560867:0:14480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bc850c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:297779ff-2cb2-4723-b8d5-25521c7fc733+12:13763:x1877943286610688:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 Request processed in 189us (4373us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946675.560874:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 105 00000100:00100000:1.0:1790946675.582474:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946675.582555:0:14481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286610816 00000100:00100000:2.0:1790946675.582565:0:14481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286610816 00000100:00100000:2.0:1790946675.582615:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 106 00000100:00100000:2.0:1790946675.582625:0:14481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bc851c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:297779ff-2cb2-4723-b8d5-25521c7fc733+12:13763:x1877943286610816:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790946675.582908:0:14481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bc851c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:297779ff-2cb2-4723-b8d5-25521c7fc733+12:13763:x1877943286610816:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 Request processed in 284us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946675.582916:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 106 00000100:00100000:3.0:1790946675.593963:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946675.594044:0:14478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286610944 00000100:00100000:2.0:1790946675.594053:0:14478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286610944 00000100:00100000:2.0:1790946675.594109:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 107 00000100:00100000:2.0:1790946675.594118:0:14478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bc851450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:297779ff-2cb2-4723-b8d5-25521c7fc733+12:13763:x1877943286610944:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790946675.594360:0:14478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bc851450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:297779ff-2cb2-4723-b8d5-25521c7fc733+12:13763:x1877943286610944:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 Request processed in 242us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946675.594375:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 107 00000100:00100000:1.0:1790946675.608649:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946675.608736:0:14480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286611072 00000100:00100000:3.0:1790946675.608755:0:14480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286611072 00000100:00100000:3.0:1790946675.608807:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 108 00000100:00100000:3.0:1790946675.608817:0:14480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bc853450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:297779ff-2cb2-4723-b8d5-25521c7fc733+12:13763:x1877943286611072:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790946675.608833:0:14480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946675.608850:0:14480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9146be9f7e00/0x16e41aef932730a9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x826f92adbe0d105 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946675.608878:0:14480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9146be9f7e00/0x16e41aef932730a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d105 expref: 13 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946675.608931:0:14480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9146be9f7e00/0x16e41aef932730a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d105 expref: 13 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946675.608954:0:14480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146be9f7e00, rc 0) 00000100:00100000:3.0:1790946675.609006:0:14480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bc853450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:297779ff-2cb2-4723-b8d5-25521c7fc733+13:13763:x1877943286611072:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 Request processed in 190us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946675.609014:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 108 00000100:00100000:1.0:1790946675.613499:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946675.613569:0:14481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286611200 00000100:00100000:3.0:1790946675.613579:0:14481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286611200 00000100:00100000:3.0:1790946675.613633:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 109 00000100:00100000:3.0:1790946675.613642:0:14481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bc853c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:297779ff-2cb2-4723-b8d5-25521c7fc733+13:13763:x1877943286611200:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790946675.613930:0:14481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bc853c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:297779ff-2cb2-4723-b8d5-25521c7fc733+13:13763:x1877943286611200:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 Request processed in 289us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946675.613939:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 109 00000100:00100000:3.0:1790946675.621663:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946675.621736:0:14478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286611328 00000100:00100000:1.0:1790946675.621753:0:14478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286611328 00000100:00100000:1.0:1790946675.621807:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 110 00000100:00100000:1.0:1790946675.621816:0:14478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bc853050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:297779ff-2cb2-4723-b8d5-25521c7fc733+13:13763:x1877943286611328:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790946675.622036:0:14478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bc853050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:297779ff-2cb2-4723-b8d5-25521c7fc733+13:13763:x1877943286611328:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 Request processed in 219us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946675.622044:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 110 00010000:00010000:2.0:1790946675.890945:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1790946675.953292:0:14483:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790946675.953299:0:14483:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9146a0073000 from 10 10000000:01000000:2.0:1790946675.953304:0:14483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790946675.953353:0:14483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff914688aeea00/0x16e41aef932730b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946675.953366:0:14483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff914688aeea00/0x16e41aef932730b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946675.953377:0:14483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff914688aeea00/0x16e41aef932730b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946675.953401:0:14483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5a6a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14483:1877943303381888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790946675.953467:0:14483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946675.953515:0:14483:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146879c7c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790946675.954401:0:14480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303381888 00000100:00100000:3.0:1790946675.954410:0:14480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303381888 00000100:00100000:3.0:1790946675.954463:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1790946675.954471:0:14480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bc853850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+16:14483:x1877943303381888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790946675.954485:0:14480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946675.954499:0:14480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9146be9f6c00/0x16e41aef932730b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x16e41aef932730b0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946675.954521:0:14480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9146be9f6c00/0x16e41aef932730b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x16e41aef932730b0 expref: 17 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946675.954532:0:14480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9146be9f6c00/0x16e41aef932730b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef932730b0 expref: 17 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946675.954557:0:14480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146be9f6c00, rc 0) 00000100:00100000:3.0:1790946675.954605:0:14480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bc853850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+17:14483:x1877943303381888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (1139us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946675.954612:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1790946675.954704:0:14483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5a6a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14483:1877943303381888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790946675.954721:0:14483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff914688aeea00/0x16e41aef932730b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef932730b7 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946675.954730:0:14483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff914688aeea00/0x16e41aef932730b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef932730b7 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946675.954803:0:14483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91469829f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14483:1877943303382016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790946675.954836:0:14483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946675.954863:0:14483:0:(client.c:2716:ptlrpc_set_wait()) set ffff91468485cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1790946675.954977:0:14481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303382016 00000100:00100000:3.0:1790946675.954981:0:14481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303382016 00000100:00100000:3.0:1790946675.955008:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1790946675.955014:0:14481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bc852c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+17:14483:x1877943303382016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790946675.955239:0:14481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bc852c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+17:14483:x1877943303382016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 225us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946675.956075:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1790946675.956126:0:14483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91469829f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14483:1877943303382016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790946675.956164:0:14483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be127b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14483:1877943303382144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790946675.956512:0:14483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946675.958575:0:14483:0:(client.c:2716:ptlrpc_set_wait()) set ffff914684eb89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790946675.960727:0:14480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303382144 00000100:00100000:0.0:1790946675.960752:0:14480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303382144 00000100:00100000:0.0:1790946675.960817:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1790946675.960828:0:14480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bc851850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+17:14483:x1877943303382144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790946675.961177:0:14480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bc851850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+17:14483:x1877943303382144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 350us (4664us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946675.961185:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1790946675.961622:0:14483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be127b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14483:1877943303382144:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790946675.967787:0:16670:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1790946675.968071:0:14483:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1790946675.968093:0:14483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790946675.968105:0:14483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff914688aeea00/0x16e41aef932730b0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef932730b7 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946675.968116:0:14483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff914688aeea00/0x16e41aef932730b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef932730b7 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790946675.968127:0:14483:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790946675.968130:0:14483:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9146b7977800 from 10 10000000:01000000:1.0:1790946675.968133:0:14483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790946675.968172:0:14483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff914680030c00/0x16e41aef932730be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946675.968180:0:14483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff914680030c00/0x16e41aef932730be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946675.968191:0:14483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff914680030c00/0x16e41aef932730be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946675.968263:0:14483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cf9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14483:1877943303382272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790946675.968325:0:14483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946675.968363:0:14483:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146be9aa000 going to sleep for 11 seconds 00000100:00100000:3.0:1790946675.968501:0:14481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303382272 00000100:00100000:3.0:1790946675.968510:0:14481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303382272 00000100:00100000:3.0:1790946675.968725:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1790946675.968735:0:14481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bc851050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+17:14483:x1877943303382272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790946675.968759:0:14481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946675.968772:0:14481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9146be9f6e00/0x16e41aef932730c5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x16e41aef932730be expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946675.968886:0:14481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9146be9f6e00/0x16e41aef932730c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x16e41aef932730be expref: 18 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946675.968910:0:14481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9146be9f6e00/0x16e41aef932730c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef932730be expref: 18 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946675.968919:0:14481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146be9f6e00, rc 0) 00000100:00100000:3.0:1790946675.968971:0:14481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bc851050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+18:14483:x1877943303382272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 238us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946675.968978:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1790946675.969620:0:14483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cf9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14483:1877943303382272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790946675.969638:0:14483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff914680030c00/0x16e41aef932730be lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef932730c5 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946675.969649:0:14483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff914680030c00/0x16e41aef932730be lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef932730c5 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946675.969705:0:14483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146c1cf9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14483:1877943303382400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790946675.969750:0:14483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946675.969797:0:14483:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146be9aa000 going to sleep for 11 seconds 00000100:00100000:3.0:1790946675.970105:0:14480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303382400 00000100:00100000:3.0:1790946675.970110:0:14480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303382400 00000100:00100000:3.0:1790946675.970149:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1790946675.970156:0:14480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bc852450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+18:14483:x1877943303382400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790946675.970644:0:14480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bc852450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+18:14483:x1877943303382400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 486us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946675.970654:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1790946675.981301:0:14483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146c1cf9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14483:1877943303382400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790946675.981520:0:14483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5a6b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14483:1877943303382528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790946675.981594:0:14483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946675.981636:0:14483:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146879c7600 going to sleep for 11 seconds 00000100:00100000:1.0:1790946675.981689:0:14478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303382528 00000100:00100000:1.0:1790946675.981696:0:14478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303382528 00000100:00100000:1.0:1790946675.981753:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1790946675.981763:0:14478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bc850050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+18:14483:x1877943303382528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790946675.981952:0:14478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bc850050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+18:14483:x1877943303382528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 191us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946675.981960:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1790946675.982194:0:14483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5a6b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14483:1877943303382528:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1790946675.984943:0:16672:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1790946675.985183:0:14483:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1790946675.985230:0:14483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790946675.985248:0:14483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff914680030c00/0x16e41aef932730be lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef932730c5 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946675.985260:0:14483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff914680030c00/0x16e41aef932730be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef932730c5 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790946675.985270:0:14483:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790946675.985284:0:14483:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff914586f39800 from 10 10000000:01000000:2.0:1790946675.985287:0:14483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790946675.985318:0:14483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff914688aefc00/0x16e41aef932730cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946675.985326:0:14483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff914688aefc00/0x16e41aef932730cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946675.985338:0:14483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff914688aefc00/0x16e41aef932730cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946675.985362:0:14483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5a6aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14483:1877943303382656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790946675.985423:0:14483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790946675.985462:0:14483:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146879c7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790946675.989369:0:14480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303382656 00000100:00100000:0.0:1790946675.989382:0:14480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303382656 00000100:00100000:0.0:1790946675.989439:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1790946675.989450:0:14480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bc850850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+18:14483:x1877943303382656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790946675.989467:0:14480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946675.989486:0:14480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9146b1932800/0x16e41aef932730d3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x16e41aef932730cc expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946675.989512:0:14480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9146b1932800/0x16e41aef932730d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x16e41aef932730cc expref: 19 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946675.989523:0:14480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9146b1932800/0x16e41aef932730d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x16e41aef932730cc expref: 19 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946675.989531:0:14480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b1932800, rc 0) 00000100:00100000:0.0:1790946675.989599:0:14480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bc850850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+19:14483:x1877943303382656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (4176us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946675.989613:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1790946675.989667:0:14483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5a6aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14483:1877943303382656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790946675.989685:0:14483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff914688aefc00/0x16e41aef932730cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef932730d3 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946675.989694:0:14483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff914688aefc00/0x16e41aef932730cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x16e41aef932730d3 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946675.989768:0:14483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91469829c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14483:1877943303382784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790946675.990015:0:14483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946675.990043:0:14481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303382784 00000100:00100000:0.0:1790946675.990047:0:14481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303382784 00000100:00100000:0.0:1790946675.990070:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1790946675.990076:0:14481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bc852850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+19:14483:x1877943303382784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790946675.990404:0:14481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bc852850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+19:14483:x1877943303382784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 328us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946675.990412:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1790946675.990447:0:14483:0:(client.c:2716:ptlrpc_set_wait()) set ffff91468eb6ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1790946675.990459:0:14483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91469829c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14483:1877943303382784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790946675.990487:0:14483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91469829c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14483:1877943303382912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790946675.990523:0:14483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946675.990542:0:14481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303382912 00000100:00100000:0.0:1790946675.990546:0:14481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303382912 00000100:00100000:0.0:1790946675.990566:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1790946675.990572:0:14481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146bc852050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+19:14483:x1877943303382912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790946675.990703:0:14481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146bc852050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+19:14483:x1877943303382912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 131us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946675.990710:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1790946675.990748:0:14483:0:(client.c:2716:ptlrpc_set_wait()) set ffff91468eb6ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1790946675.990760:0:14483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91469829c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:14483:1877943303382912:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1790946675.994409:0:16673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1790946676.003387:0:14483:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1790946676.003429:0:14483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790946676.003442:0:14483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff914688aefc00/0x16e41aef932730cc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef932730d3 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946676.003462:0:14483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff914688aefc00/0x16e41aef932730cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x16e41aef932730d3 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946676.912540:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946677.473309:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946677.473414:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946677.473451:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946677.473486:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946677.473509:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946677.473548:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946677.473581:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946677.473586:0:16113:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286611968 00000100:00100000:3.0:1790946677.473609:0:15168:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286611712 00000100:00100000:2.0:1790946677.473615:0:16113:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286611968 00000100:00100000:3.0:1790946677.473632:0:15168:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286611712 00000100:00100000:1.0:1790946677.473721:0:15171:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286612224 00000100:00100000:1.0:1790946677.473735:0:15171:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286612224 00000100:00100000:2.0:1790946677.473744:0:16113:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286611584 00000100:00100000:2.0:1790946677.473754:0:16113:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286611584 00000100:00100000:0.0:1790946677.474544:0:14481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286611456 00000100:00100000:0.0:1790946677.474553:0:14481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286611456 00000100:00100000:0.0:1790946677.474606:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 120 00000100:00100000:0.0:1790946677.474678:0:14481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5804850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:297779ff-2cb2-4723-b8d5-25521c7fc733+13:2362:x1877943286611456:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1790946677.475027:0:14481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5804850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:297779ff-2cb2-4723-b8d5-25521c7fc733+13:2362:x1877943286611456:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 410us (1725us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946677.475036:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 120 00000100:00100000:3.0:1790946677.475395:0:15168:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286611840 00000100:00100000:3.0:1790946677.475401:0:15168:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286611840 00000100:00100000:3.0:1790946677.475419:0:15168:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286612096 00000100:00100000:3.0:1790946677.475422:0:15168:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286612096 00000100:00100000:3.0:1790946677.475455:0:15168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:3.0:1790946677.475462:0:15168:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be127100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:367257b9-14b9-4792-8ebc-8eea5a9ade3a+5:2362:x1877943286611712:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790946677.475495:0:15168:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be127100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:367257b9-14b9-4792-8ebc-8eea5a9ade3a+5:2362:x1877943286611712:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 35us (2082us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946677.475502:0:15168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:3.0:1790946677.475515:0:15168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:3.0:1790946677.475521:0:15168:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be125180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:367257b9-14b9-4792-8ebc-8eea5a9ade3a+5:2362:x1877943286611840:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790946677.475544:0:15168:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be125180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:367257b9-14b9-4792-8ebc-8eea5a9ade3a+5:2362:x1877943286611840:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 23us (1995us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946677.475550:0:15168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:3.0:1790946677.475561:0:15168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00100000:3.0:1790946677.475567:0:15168:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be127b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d8c7f7a5-9948-489b-83db-1b4a989e21d4+5:2362:x1877943286612096:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790946677.475668:0:15168:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be127b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d8c7f7a5-9948-489b-83db-1b4a989e21d4+5:2362:x1877943286612096:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 23us (2009us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946677.475676:0:15168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00100000:3.0:1790946677.475710:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00100000:3.0:1790946677.475719:0:14488:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be126d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8c7f7a5-9948-489b-83db-1b4a989e21d4+6:2362:x1877943286611968:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1790946677.475772:0:14488:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be126d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8c7f7a5-9948-489b-83db-1b4a989e21d4+6:2362:x1877943286611968:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 55us (2320us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946677.475778:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00100000:1.0:1790946677.476922:0:15171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:1.0:1790946677.476934:0:15171:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be126300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d8c7f7a5-9948-489b-83db-1b4a989e21d4+5:2362:x1877943286612224:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790946677.477127:0:15171:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be126300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d8c7f7a5-9948-489b-83db-1b4a989e21d4+5:2362:x1877943286612224:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 196us (3639us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946677.477135:0:15171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:2.0:1790946677.480675:0:16113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 25 00000100:00100000:2.0:1790946677.480695:0:16113:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be125880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:367257b9-14b9-4792-8ebc-8eea5a9ade3a+6:2362:x1877943286611584:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790946677.482763:0:16113:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be125880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:367257b9-14b9-4792-8ebc-8eea5a9ade3a+6:2362:x1877943286611584:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 2057us (9235us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946677.482779:0:16113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 25 00000100:00080000:0.0:1790946677.486516:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790946677.486526:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790946677.486529:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1790946677.945702:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946678.256585:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790946678.256618:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5eb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303383040:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790946678.256739:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946678.256943:0:15172:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303383040 00000100:00100000:3.0:1790946678.256954:0:15172:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303383040 00000100:00100000:3.0:1790946678.257042:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790946678.257054:0:15172:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303383040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790946678.257130:0:15172:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790946678.257190:0:15172:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303383040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 138us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946678.257225:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1790946678.257411:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790946678.257516:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5eb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303383040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790946678.278616:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946678.279937:0:14488:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286612352 00000100:00100000:1.0:1790946678.279969:0:14488:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286612352 00000100:00100000:1.0:1790946678.280137:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00100000:1.0:1790946678.280153:0:14488:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5eb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:367257b9-14b9-4792-8ebc-8eea5a9ade3a+6:14421:x1877943286612352:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790946678.280185:0:14488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946678.280256:0:14488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914680031600/0x16e41aef932730da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0d10c expref: -99 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946678.280345:0:14488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff914680031c00/0x16e41aef932730e1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946678.280382:0:14488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914680031c00/0x16e41aef932730e1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946678.280398:0:14488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914680031c00/0x16e41aef932730e1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946678.280421:0:14488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff914680031a00/0x16e41aef932730e8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946678.280429:0:14488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914680031a00/0x16e41aef932730e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946678.280436:0:14488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914680031a00/0x16e41aef932730e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946678.281909:0:14488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff914680031e00/0x16e41aef932730ef lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946678.281936:0:14488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914680031e00/0x16e41aef932730ef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946678.281952:0:14488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914680031e00/0x16e41aef932730ef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790946678.282341:0:14488:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790946678.282347:0:14488:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790946678.282682:0:14488:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff914680031e00/0x16e41aef932730ef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946678.282702:0:14488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff914680031c00/0x16e41aef932730e1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946678.282741:0:14488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff914680031c00/0x16e41aef932730e1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946678.282749:0:14488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff914680031c00/0x16e41aef932730e1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946678.282756:0:14488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914680031c00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:1.0:1790946678.282762:0:14488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914680031c00/0x16e41aef932730e1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946678.282771:0:14488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914680031c00/0x16e41aef932730e1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946678.282786:0:14488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff914683831700) 00010000:00010000:1.0:1790946678.282789:0:14488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790946678.282795:0:14488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff914680031c00/0x16e41aef932730e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946678.282801:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914680031c00/0x16e41aef932730e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946678.282821:0:14488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff914680031a00/0x16e41aef932730e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946678.282828:0:14488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff914680031a00/0x16e41aef932730e8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946678.282834:0:14488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff914680031a00/0x16e41aef932730e8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946678.282839:0:14488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914680031a00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:1.0:1790946678.282849:0:14488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914680031a00/0x16e41aef932730e8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946678.282856:0:14488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914680031a00/0x16e41aef932730e8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946678.282864:0:14488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff91469e29d900) 00010000:00010000:1.0:1790946678.282867:0:14488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790946678.282871:0:14488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff914680031a00/0x16e41aef932730e8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946678.282877:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914680031a00/0x16e41aef932730e8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946678.282930:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914680031600/0x16e41aef932730da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d10c expref: 8 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946678.282959:0:14488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff914680031e00/0x16e41aef932730ef lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d10c expref: 7 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946678.282967:0:14488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff91469e29d400) 00010000:00010000:1.0:1790946678.282969:0:14488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790946678.283425:0:14488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914680031e00, rc 0) 00000100:00100000:1.0:1790946678.283533:0:14488:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5eb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:367257b9-14b9-4792-8ebc-8eea5a9ade3a+7:14421:x1877943286612352:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 3382us (5356us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946678.283544:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00100000:3.0:1790946678.289362:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946678.290028:0:14487:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286612608 00000100:00100000:1.0:1790946678.290048:0:14487:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286612608 00000100:00100000:1.0:1790946678.290141:0:14487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:1.0:1790946678.290152:0:14487:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5eb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:367257b9-14b9-4792-8ebc-8eea5a9ade3a+7:14421:x1877943286612608:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790946678.290229:0:14487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946678.290257:0:14487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914680030600/0x16e41aef932730f6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0d113 expref: -99 pid: 14487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946678.290367:0:14487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff914680031200/0x16e41aef932730fd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946678.290386:0:14487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914680031200/0x16e41aef932730fd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946678.290399:0:14487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914680031200/0x16e41aef932730fd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946678.294006:0:14487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef93273104 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946678.294053:0:14487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef93273104 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946678.294065:0:14487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef93273104 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946678.294426:0:14487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef9327310b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946678.294436:0:14487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef9327310b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946678.294444:0:14487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef9327310b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790946678.294456:0:14487:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1790946678.294656:0:14487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff914680031200/0x16e41aef932730fd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946678.294665:0:14487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff914680031200/0x16e41aef932730fd lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946678.294672:0:14487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff914680031200/0x16e41aef932730fd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946678.294678:0:14487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914680031200 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:1.0:1790946678.294683:0:14487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914680031200/0x16e41aef932730fd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946678.294691:0:14487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914680031200/0x16e41aef932730fd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946678.294702:0:14487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff91469e29d400) 00010000:00010000:1.0:1790946678.294705:0:14487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790946678.294709:0:14487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff914680031200/0x16e41aef932730fd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946678.294714:0:14487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914680031200/0x16e41aef932730fd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946678.294741:0:14487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef93273104 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946678.294747:0:14487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef93273104 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946678.294752:0:14487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef93273104 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946678.294767:0:14487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180ee00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:1.0:1790946678.294771:0:14487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef93273104 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946678.294778:0:14487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef93273104 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946678.294786:0:14487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff91469e29d300) 00010000:00010000:1.0:1790946678.294789:0:14487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790946678.294792:0:14487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef93273104 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946678.294798:0:14487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180ee00/0x16e41aef93273104 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946678.295326:0:14487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914680030600/0x16e41aef932730f6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d113 expref: 10 pid: 14487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946678.295344:0:14487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fc00/0x16e41aef9327310b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d113 expref: 9 pid: 14487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946678.295352:0:14487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91469e29d100) 00010000:00010000:1.0:1790946678.295355:0:14487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790946678.295358:0:14487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b180fc00, rc 0) 00000100:00100000:1.0:1790946678.295439:0:14487:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5eb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:367257b9-14b9-4792-8ebc-8eea5a9ade3a+9:14421:x1877943286612608:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 5288us (6239us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1790946678.295447:0:14487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:3.0:1790946678.302738:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946678.302854:0:14486:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286612736 00000100:00100000:0.0:1790946678.302871:0:14486:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286612736 00000100:00100000:0.0:1790946678.302958:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:0.0:1790946678.302968:0:14486:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5eb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:367257b9-14b9-4792-8ebc-8eea5a9ade3a+9:14421:x1877943286612736:12345-192.168.203.13@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1790946678.303080:0:14486:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5eb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:367257b9-14b9-4792-8ebc-8eea5a9ade3a+9:14421:x1877943286612736:12345-192.168.203.13@tcp:59:lhsmtool_posix.0 Request processed in 113us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946678.303087:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:3.0:1790946678.367280:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946678.367494:0:16113:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286612864 00000100:00100000:2.0:1790946678.367507:0:16113:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286612864 00000100:00100000:2.0:1790946678.367582:0:16113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:2.0:1790946678.367593:0:16113:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5eb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:367257b9-14b9-4792-8ebc-8eea5a9ade3a+9:14427:x1877943286612864:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1790946678.367638:0:16113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946678.367668:0:16113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefe00/0x16e41aef93273119 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0d11a expref: -99 pid: 16113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946678.367992:0:16113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeee00/0x16e41aef93273120 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946678.368010:0:16113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeee00/0x16e41aef93273120 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946678.368024:0:16113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeee00/0x16e41aef93273120 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946678.368041:0:16113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93273127 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946678.368048:0:16113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93273127 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946678.368056:0:16113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93273127 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.369185:0:16113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeee00/0x16e41aef93273120 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.369227:0:16113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeee00/0x16e41aef93273120 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.369237:0:16113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeee00/0x16e41aef93273120 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.369243:0:16113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aeee00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946678.369249:0:16113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeee00/0x16e41aef93273120 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.369259:0:16113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeee00/0x16e41aef93273120 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.369276:0:16113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff914683831700) 00010000:00010000:3.0:1790946678.369279:0:16113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946678.369285:0:16113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeee00/0x16e41aef93273120 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.369368:0:16113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeee00/0x16e41aef93273120 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.369396:0:16113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93273127 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.369403:0:16113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93273127 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.369410:0:16113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93273127 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.369415:0:16113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aee600 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946678.369418:0:16113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93273127 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.369425:0:16113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93273127 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.369434:0:16113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9146a0a5ee00) 00010000:00010000:3.0:1790946678.369436:0:16113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946678.369439:0:16113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93273127 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.369445:0:16113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93273127 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.369497:0:16113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefe00/0x16e41aef93273119 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d11a expref: 10 pid: 16113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.369509:0:16113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff914683831700) 00010000:00010000:3.0:1790946678.369512:0:16113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946678.369522:0:16113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefe00/0x16e41aef93273119 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d11a expref: 10 pid: 16113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.369532:0:16113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914688aefe00, rc 0) 00000100:00100000:3.0:1790946678.369689:0:16113:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5eb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:367257b9-14b9-4792-8ebc-8eea5a9ade3a+9:14427:x1877943286612864:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 2096us (2421us total) trans 0 rc 301/301 00000100:00100000:3.0:1790946678.369699:0:16113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:3.0:1790946678.374453:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946678.374591:0:14495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286612992 00000100:00100000:0.0:1790946678.374605:0:14495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286612992 00000100:00100000:0.0:1790946678.374688:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:0.0:1790946678.374699:0:14495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5eb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:367257b9-14b9-4792-8ebc-8eea5a9ade3a+9:14427:x1877943286612992:12345-192.168.203.13@tcp:700:lfs.0 00000100:00100000:0.0:1790946678.374862:0:14495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5eb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:367257b9-14b9-4792-8ebc-8eea5a9ade3a+9:14427:x1877943286612992:12345-192.168.203.13@tcp:700:lfs.0 Request processed in 164us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946678.374872:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:1.0:1790946678.378087:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946678.378509:0:14486:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286613248 00000100:00100000:0.0:1790946678.378523:0:14486:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286613248 00000100:00100000:0.0:1790946678.378634:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:0.0:1790946678.378647:0:14486:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:367257b9-14b9-4792-8ebc-8eea5a9ade3a+9:14427:x1877943286613248:12345-192.168.203.13@tcp:36:lfs.0 00010000:00010000:0.0:1790946678.378742:0:14486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790946678.378777:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932a00/0x16e41aef9327305c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d095 expref: 9 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946678.378802:0:14486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff914683831700) 00010000:00010000:0.0:1790946678.378808:0:14486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790946678.379085:0:14486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef9327312e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946678.379101:0:14486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef93273094 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d0f7 expref: 5 pid: 14487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946678.379111:0:14486:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef9327312e lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946678.379151:0:14486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef93273094 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d0f7 expref: 5 pid: 14487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946678.379165:0:14486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef93273094 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d0f7 expref: 5 pid: 14487 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946678.379189:0:14486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91469829c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14486:1877943303383168:192.168.203.13@tcp:104: 00000100:00100000:0.0:1790946678.379575:0:14486:0:(client.c:2716:ptlrpc_set_wait()) set ffff914683162cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790946678.383549:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946678.383658:0:14486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91469829c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14486:1877943303383168:192.168.203.13@tcp:104: 00010000:00010000:0.0:1790946678.383691:0:14486:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef9327312e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946678.384623:0:14471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286613376 00000100:00100000:3.0:1790946678.384637:0:14471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286613376 00010000:00010000:3.0:1790946678.384693:0:14471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef93273094 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d0f7 expref: 6 pid: 14487 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946678.384869:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:3.0:1790946678.384881:0:14471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8c7f7a5-9948-489b-83db-1b4a989e21d4+6:2364:x1877943286613376:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790946678.384902:0:14471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790946678.384910:0:14471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef93273094 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d0f7 expref: 6 pid: 14487 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.384925:0:14471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef93273094 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d0f7 expref: 6 pid: 14487 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.384952:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146be9f6800/0x16e41aef93273094 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d0f7 expref: 6 pid: 14487 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.384974:0:14471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff914683831700) 00010000:00010000:3.0:1790946678.384981:0:14471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef9327312e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.385014:0:14471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef9327312e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.385023:0:14471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef9327312e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.385056:0:14471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790946678.385132:0:14471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8c7f7a5-9948-489b-83db-1b4a989e21d4+5:2364:x1877943286613376:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 254us (1598us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946678.385141:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 9 00010000:00010000:0.0:1790946678.385714:0:14486:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef9327312e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946678.385735:0:14486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef9327312e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946678.385766:0:14486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933000/0x16e41aef93273135 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946678.385780:0:14486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933000/0x16e41aef93273135 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946678.385791:0:14486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933000/0x16e41aef93273135 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790946678.387786:0:14486:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1790946678.387809:0:14486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef9327312e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946678.387820:0:14486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef9327312e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946678.387829:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef9327312e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946678.387846:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1933200 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:0.0:1790946678.387851:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef9327312e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946678.387860:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef9327312e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946678.387879:0:14486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff914683831700) 00010000:00010000:0.0:1790946678.387882:0:14486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790946678.387887:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef9327312e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946678.387894:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef9327312e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790946678.387919:0:14486:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000df28ce02 reply state 00000000e2565c7a transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933000/0x16e41aef93273135 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946678.387930:0:14486:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790946678.388074:0:14486:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:367257b9-14b9-4792-8ebc-8eea5a9ade3a+10:14427:x1877943286613248:12345-192.168.203.13@tcp:36:lfs.0 Request processed in 9424us (9997us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1790946678.388084:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 19 00010000:00010000:2.0:1790946678.392284:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933000/0x16e41aef93273135 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946678.392317:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933000/0x16e41aef93273135 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946678.392326:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933000/0x16e41aef93273135 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946678.392333:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1933000 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:2.0:1790946678.392346:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933000/0x16e41aef93273135 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946678.392356:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933000/0x16e41aef93273135 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946678.392374:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff914683831100) 00010000:00010000:2.0:1790946678.392378:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790946678.392392:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933000/0x16e41aef93273135 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946678.392399:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933000/0x16e41aef93273135 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946678.473237:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946678.473409:0:14487:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286613504 00000100:00100000:1.0:1790946678.473425:0:14487:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286613504 00000100:00100000:1.0:1790946678.473501:0:14487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:1.0:1790946678.473512:0:14487:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5a68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:367257b9-14b9-4792-8ebc-8eea5a9ade3a+9:14435:x1877943286613504:12345-192.168.203.13@tcp:101:lctl.0 00010000:00010000:1.0:1790946678.473543:0:14487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946678.473572:0:14487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f000/0x16e41aef9327313c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0d121 expref: -99 pid: 14487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946678.473659:0:14487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93273143 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946678.473675:0:14487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93273143 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946678.473688:0:14487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93273143 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790946678.473745:0:14487:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790946678.473750:0:14487:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790946678.473801:0:14487:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93273143 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946678.473831:0:14487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f000/0x16e41aef9327313c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d121 expref: 11 pid: 14487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946678.473868:0:14487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f800/0x16e41aef93273143 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d121 expref: 10 pid: 14487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946678.473878:0:14487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91469e29d300) 00010000:00010000:1.0:1790946678.473899:0:14487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790946678.473904:0:14487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b180f800, rc 0) 00000100:00100000:1.0:1790946678.474274:0:14487:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5a68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:367257b9-14b9-4792-8ebc-8eea5a9ade3a+10:14435:x1877943286613504:12345-192.168.203.13@tcp:101:lctl.0 Request processed in 761us (1075us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946678.474283:0:14487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:1.0:1790946678.505931:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946678.506037:0:14488:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286613632 00000100:00100000:3.0:1790946678.506051:0:14488:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286613632 00000100:00100000:3.0:1790946678.506124:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:3.0:1790946678.506135:0:14488:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8c7f7a5-9948-489b-83db-1b4a989e21d4+5:14436:x1877943286613632:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1790946678.506168:0:14488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946678.506195:0:14488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ac00/0x16e41aef9327314a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0d128 expref: -99 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.506311:0:14488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032aa00/0x16e41aef93273151 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.506329:0:14488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032aa00/0x16e41aef93273151 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.506343:0:14488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032aa00/0x16e41aef93273151 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790946678.506399:0:14488:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790946678.506405:0:14488:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790946678.506452:0:14488:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032aa00/0x16e41aef93273151 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.506484:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ac00/0x16e41aef9327314a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d128 expref: 7 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.506505:0:14488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032aa00/0x16e41aef93273151 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d128 expref: 6 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.506516:0:14488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91469e29d300) 00010000:00010000:3.0:1790946678.506518:0:14488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790946678.506523:0:14488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146a032aa00, rc 0) 00000100:00100000:3.0:1790946678.506600:0:14488:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8c7f7a5-9948-489b-83db-1b4a989e21d4+6:14436:x1877943286613632:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 466us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946678.506608:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 21 00000040:00080000:3.0:1790946678.513007:0:14517:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1790946678.517148:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946678.517471:0:16113:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286613760 00000100:00100000:3.0:1790946678.517483:0:16113:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286613760 00000100:00100000:3.0:1790946678.517560:0:16113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00100000:3.0:1790946678.517572:0:16113:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91469829c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8c7f7a5-9948-489b-83db-1b4a989e21d4+6:14436:x1877943286613760:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1790946678.517600:0:16113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946678.517628:0:16113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ac00/0x16e41aef93273158 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0d12f expref: -99 pid: 16113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.518134:0:16113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a600/0x16e41aef9327315f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.518154:0:16113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a600/0x16e41aef9327315f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.518192:0:16113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a600/0x16e41aef9327315f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.518250:0:16113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b600/0x16e41aef93273166 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.518259:0:16113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b600/0x16e41aef93273166 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.518267:0:16113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b600/0x16e41aef93273166 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.519186:0:16113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b200/0x16e41aef9327316d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.519325:0:16113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b200/0x16e41aef9327316d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.519339:0:16113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b200/0x16e41aef9327316d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790946678.519382:0:16113:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790946678.519386:0:16113:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790946678.519406:0:16113:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b200/0x16e41aef9327316d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.519419:0:16113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a600/0x16e41aef9327315f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.519426:0:16113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a600/0x16e41aef9327315f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.519451:0:16113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a600/0x16e41aef9327315f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.519457:0:16113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146a032a600 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946678.519461:0:16113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a600/0x16e41aef9327315f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.519470:0:16113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a600/0x16e41aef9327315f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.519482:0:16113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91469e29d300) 00010000:00010000:3.0:1790946678.520444:0:16113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946678.520453:0:16113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a600/0x16e41aef9327315f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.520462:0:16113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a600/0x16e41aef9327315f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.520815:0:16113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b600/0x16e41aef93273166 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.520826:0:16113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b600/0x16e41aef93273166 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.520833:0:16113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b600/0x16e41aef93273166 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.520838:0:16113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146a032b600 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946678.520841:0:16113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b600/0x16e41aef93273166 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.520864:0:16113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b600/0x16e41aef93273166 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.520876:0:16113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9146836dfc00) 00010000:00010000:3.0:1790946678.520879:0:16113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946678.520882:0:16113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b600/0x16e41aef93273166 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.520888:0:16113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b600/0x16e41aef93273166 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.520935:0:16113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ac00/0x16e41aef93273158 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d12f expref: 8 pid: 16113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.520949:0:16113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b200/0x16e41aef9327316d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d12f expref: 7 pid: 16113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.520956:0:16113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9146836df400) 00010000:00010000:3.0:1790946678.520958:0:16113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790946678.520961:0:16113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146a032b200, rc 0) 00000100:00100000:3.0:1790946678.521043:0:16113:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91469829c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8c7f7a5-9948-489b-83db-1b4a989e21d4+7:14436:x1877943286613760:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 3472us (3907us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946678.521052:0:16113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00100000:2.0:1790946678.528892:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946678.529016:0:14488:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286614016 00000100:00100000:3.0:1790946678.529030:0:14488:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286614016 00000100:00100000:3.0:1790946678.529261:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 23 00000100:00100000:3.0:1790946678.529273:0:14488:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5a68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8c7f7a5-9948-489b-83db-1b4a989e21d4+7:14436:x1877943286614016:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1790946678.529333:0:14488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946678.529358:0:14488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ac00/0x16e41aef93273174 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0d136 expref: -99 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790946678.529490:0:14488:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1790946678.529648:0:14488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ac00/0x16e41aef93273174 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d136 expref: 9 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.529665:0:14488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91469e29d300) 00010000:00010000:3.0:1790946678.529668:0:14488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790946678.529673:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ac00/0x16e41aef93273174 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d136 expref: 9 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.529688:0:14488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146a032ac00, rc 0) 00000100:00100000:3.0:1790946678.529785:0:14488:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5a68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8c7f7a5-9948-489b-83db-1b4a989e21d4+8:14436:x1877943286614016:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 514us (907us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1790946678.529793:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 23 00000100:00100000:1.0:1790946678.533921:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946678.534077:0:14487:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286614272 00000100:00100000:0.0:1790946678.534090:0:14487:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286614272 00000100:00100000:0.0:1790946678.534158:0:14487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00100000:0.0:1790946678.534168:0:14487:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8c7f7a5-9948-489b-83db-1b4a989e21d4+8:14436:x1877943286614272:12345-192.168.203.13@tcp:36:lfs.0 00010000:00010000:0.0:1790946678.534269:0:14487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790946678.534511:0:14487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b200/0x16e41aef9327316d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d12f expref: 8 pid: 16113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946678.534551:0:14487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9146836df400) 00010000:00010000:0.0:1790946678.534565:0:14487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790946678.534597:0:14487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932a00/0x16e41aef93273182 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946678.534612:0:14487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932a00/0x16e41aef93273182 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946678.534623:0:14487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932a00/0x16e41aef93273182 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790946678.534929:0:14487:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000007b4eac34 reply state 00000000bc3c4e03 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932a00/0x16e41aef93273182 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946678.534941:0:14487:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1790946678.534951:0:14487:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1790946678.535127:0:14487:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8c7f7a5-9948-489b-83db-1b4a989e21d4+9:14436:x1877943286614272:12345-192.168.203.13@tcp:36:lfs.0 Request processed in 958us (1214us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1790946678.535135:0:14487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00100000:1.0:1790946678.541514:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946678.542072:0:14490:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286614528 00000100:00100000:2.0:1790946678.542087:0:14490:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286614528 00000100:00100000:2.0:1790946678.542164:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 2 00000100:00100000:2.0:1790946678.542175:0:14490:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d8c7f7a5-9948-489b-83db-1b4a989e21d4+9:14436:x1877943286614528:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:2.0:1790946678.542693:0:14490:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d8c7f7a5-9948-489b-83db-1b4a989e21d4+10:14436:x1877943286614528:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 517us (1191us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1790946678.542702:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 2 00010000:00010000:0.0:1790946678.545067:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932a00/0x16e41aef93273182 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946678.545092:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932a00/0x16e41aef93273182 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946678.545102:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932a00/0x16e41aef93273182 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946678.545109:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1932a00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:0.0:1790946678.545115:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932a00/0x16e41aef93273182 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946678.545145:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932a00/0x16e41aef93273182 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946678.545164:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff914683831700) 00010000:00010000:0.0:1790946678.545168:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1790946678.545174:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932a00/0x16e41aef93273182 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946678.545181:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932a00/0x16e41aef93273182 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946678.546432:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946678.546642:0:14486:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286614784 00000100:00100000:0.0:1790946678.546656:0:14486:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286614784 00000100:00100000:0.0:1790946678.546743:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 25 00000100:00100000:0.0:1790946678.546755:0:14486:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5a6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8c7f7a5-9948-489b-83db-1b4a989e21d4+9:14436:x1877943286614784:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1790946678.546786:0:14486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946678.546811:0:14486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef93273189 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0d13d expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946678.546904:0:14486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933000/0x16e41aef93273190 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946678.546922:0:14486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933000/0x16e41aef93273190 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946678.546935:0:14486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933000/0x16e41aef93273190 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946678.546951:0:14486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933400/0x16e41aef93273197 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946678.546973:0:14486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933400/0x16e41aef93273197 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946678.546981:0:14486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933400/0x16e41aef93273197 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790946678.547124:0:14486:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1790946678.547280:0:14486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933000/0x16e41aef93273190 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946678.547304:0:14486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933000/0x16e41aef93273190 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946678.547311:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933000/0x16e41aef93273190 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946678.547317:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1933000 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:0.0:1790946678.547322:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933000/0x16e41aef93273190 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946678.547331:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933000/0x16e41aef93273190 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946678.547345:0:14486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91469e29d300) 00010000:00010000:0.0:1790946678.547348:0:14486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790946678.547354:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933000/0x16e41aef93273190 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946678.547361:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933000/0x16e41aef93273190 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946678.547816:0:14486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933400/0x16e41aef93273197 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946678.547826:0:14486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933400/0x16e41aef93273197 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946678.547831:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933400/0x16e41aef93273197 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946678.547836:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1933400 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:0.0:1790946678.547839:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933400/0x16e41aef93273197 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946678.547845:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933400/0x16e41aef93273197 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946678.547854:0:14486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff914683831300) 00010000:00010000:0.0:1790946678.547856:0:14486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790946678.547859:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933400/0x16e41aef93273197 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946678.547864:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933400/0x16e41aef93273197 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946678.547922:0:14486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef93273189 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d13d expref: 11 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946678.547934:0:14486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91469e29d300) 00010000:00010000:0.0:1790946678.547936:0:14486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790946678.547952:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef93273189 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d13d expref: 11 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946678.547962:0:14486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b1933200, rc 0) 00000100:00100000:0.0:1790946678.548058:0:14486:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5a6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8c7f7a5-9948-489b-83db-1b4a989e21d4+10:14436:x1877943286614784:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 1305us (1640us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1790946678.548068:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 25 00000100:00100000:1.0:1790946678.552139:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946678.552253:0:16113:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286614912 00000100:00100000:3.0:1790946678.552267:0:16113:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286614912 00000100:00100000:3.0:1790946678.552348:0:16113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 26 00000100:00100000:3.0:1790946678.552359:0:16113:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8c7f7a5-9948-489b-83db-1b4a989e21d4+10:14436:x1877943286614912:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1790946678.552402:0:16113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946678.552431:0:16113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ac00/0x16e41aef932731a5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0d144 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.552547:0:16113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b600/0x16e41aef932731ac lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.552598:0:16113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b600/0x16e41aef932731ac lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.552612:0:16113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b600/0x16e41aef932731ac lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790946678.552644:0:16113:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790946678.552648:0:16113:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790946678.552669:0:16113:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b600/0x16e41aef932731ac lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.552700:0:16113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ac00/0x16e41aef932731a5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d144 expref: 12 pid: 16113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.552740:0:16113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b600/0x16e41aef932731ac lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d144 expref: 11 pid: 16113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.552750:0:16113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9146836dfc00) 00010000:00010000:3.0:1790946678.552754:0:16113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790946678.552757:0:16113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146a032b600, rc 0) 00000100:00100000:3.0:1790946678.552839:0:16113:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8c7f7a5-9948-489b-83db-1b4a989e21d4+11:14436:x1877943286614912:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 481us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946678.552847:0:16113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 26 00000100:00100000:1.0:1790946678.557238:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946678.557423:0:14489:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286615040 00000100:00100000:3.0:1790946678.557436:0:14489:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286615040 00000100:00100000:3.0:1790946678.557562:0:14489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 3 00000100:00100000:3.0:1790946678.557573:0:14489:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be979f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d8c7f7a5-9948-489b-83db-1b4a989e21d4+11:14436:x1877943286615040:12345-192.168.203.13@tcp:37:lfs.0 00000100:00100000:3.0:1790946678.563934:0:14489:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be979f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d8c7f7a5-9948-489b-83db-1b4a989e21d4+11:14436:x1877943286615040:12345-192.168.203.13@tcp:37:lfs.0 Request processed in 6345us (6716us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946678.563964:0:14489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 3 00000100:00100000:1.0:1790946678.567616:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946678.567779:0:14490:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286615296 00000100:00100000:2.0:1790946678.567792:0:14490:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286615296 00000100:00100000:2.0:1790946678.567900:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:2.0:1790946678.567913:0:14490:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5fcf450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d8c7f7a5-9948-489b-83db-1b4a989e21d4+11:14436:x1877943286615296:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:2.0:1790946678.568429:0:14490:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5fcf450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d8c7f7a5-9948-489b-83db-1b4a989e21d4+12:14436:x1877943286615296:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 515us (826us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1790946678.568457:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:1.0:1790946678.639049:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946678.639453:0:14488:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286615424 00000100:00100000:3.0:1790946678.639467:0:14488:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286615424 00000100:00100000:3.0:1790946678.639544:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 27 00000100:00100000:3.0:1790946678.639556:0:14488:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be979c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:367257b9-14b9-4792-8ebc-8eea5a9ade3a+10:14442:x1877943286615424:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:3.0:1790946678.639583:0:14488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946678.639607:0:14488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ac00/0x16e41aef932731b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0d14b expref: -99 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.639692:0:14488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a600/0x16e41aef932731ba lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.639709:0:14488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a600/0x16e41aef932731ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.639739:0:14488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a600/0x16e41aef932731ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.639757:0:14488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b800/0x16e41aef932731c1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.639765:0:14488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b800/0x16e41aef932731c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.639771:0:14488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b800/0x16e41aef932731c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.640023:0:14488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b000/0x16e41aef932731c8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.640054:0:14488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b000/0x16e41aef932731c8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.640062:0:14488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b000/0x16e41aef932731c8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790946678.640097:0:14488:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790946678.640102:0:14488:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790946678.640147:0:14488:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b000/0x16e41aef932731c8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.640160:0:14488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a600/0x16e41aef932731ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.640167:0:14488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a600/0x16e41aef932731ba lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.640174:0:14488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a600/0x16e41aef932731ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.640181:0:14488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146a032a600 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946678.640186:0:14488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a600/0x16e41aef932731ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.640194:0:14488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a600/0x16e41aef932731ba lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.640573:0:14488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91469e29d300) 00010000:00010000:3.0:1790946678.640577:0:14488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946678.640583:0:14488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a600/0x16e41aef932731ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.640602:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a600/0x16e41aef932731ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.640619:0:14488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b800/0x16e41aef932731c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.640625:0:14488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b800/0x16e41aef932731c1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.640630:0:14488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b800/0x16e41aef932731c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.640636:0:14488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146a032b800 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946678.640639:0:14488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b800/0x16e41aef932731c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.640646:0:14488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b800/0x16e41aef932731c1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.640654:0:14488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9146836df900) 00010000:00010000:3.0:1790946678.640656:0:14488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946678.640659:0:14488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b800/0x16e41aef932731c1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.640665:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b800/0x16e41aef932731c1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.640773:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ac00/0x16e41aef932731b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d14b expref: 12 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.640803:0:14488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b000/0x16e41aef932731c8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d14b expref: 11 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.640882:0:14488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9146836dfc00) 00010000:00010000:3.0:1790946678.640885:0:14488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1790946678.640888:0:14488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146a032b000, rc 0) 00000100:00100000:2.0:1790946678.641144:0:14488:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be979c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:367257b9-14b9-4792-8ebc-8eea5a9ade3a+11:14442:x1877943286615424:12345-192.168.203.13@tcp:101:bash.0 Request processed in 1588us (2107us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946678.641155:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 27 00000100:00100000:1.0:1790946678.648503:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946678.648645:0:16113:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286615680 00000100:00100000:3.0:1790946678.648658:0:16113:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286615680 00000100:00100000:3.0:1790946678.648747:0:16113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 28 00000100:00100000:3.0:1790946678.648759:0:16113:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be97b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:367257b9-14b9-4792-8ebc-8eea5a9ade3a+11:14442:x1877943286615680:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:3.0:1790946678.648786:0:16113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946678.648821:0:16113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ac00/0x16e41aef932731cf lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0d152 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.649005:0:16113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b800/0x16e41aef932731d6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.649024:0:16113:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b600/0x16e41aef932731ac lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d144 expref: 11 pid: 16113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.649034:0:16113:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b800/0x16e41aef932731d6 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.649078:0:16113:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b600/0x16e41aef932731ac lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d144 expref: 11 pid: 16113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.649095:0:16113:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b600/0x16e41aef932731ac lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d144 expref: 11 pid: 16113 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946678.649121:0:16113:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5eb0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16113:1877943303383296:192.168.203.13@tcp:104: 00000100:00100000:3.0:1790946678.649299:0:16113:0:(client.c:2716:ptlrpc_set_wait()) set ffff914684847480 going to sleep for 11 seconds 00000100:00100000:3.0:1790946678.657642:0:16113:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5eb0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16113:1877943303383296:192.168.203.13@tcp:104: 00010000:00010000:3.0:1790946678.657682:0:16113:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b800/0x16e41aef932731d6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946678.659058:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946678.659250:0:14472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286615808 00000100:00100000:2.0:1790946678.659262:0:14472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286615808 00010000:00010000:2.0:1790946678.659325:0:14472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b600/0x16e41aef932731ac lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d144 expref: 12 pid: 16113 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946678.659370:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:2.0:1790946678.659379:0:14472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be978e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d8c7f7a5-9948-489b-83db-1b4a989e21d4+12:2363:x1877943286615808:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790946678.659404:0:14472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790946678.659411:0:14472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b600/0x16e41aef932731ac lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d144 expref: 12 pid: 16113 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946678.659425:0:14472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b600/0x16e41aef932731ac lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d144 expref: 12 pid: 16113 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946678.659451:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b600/0x16e41aef932731ac lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d144 expref: 12 pid: 16113 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946678.659471:0:14472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9146836dfc00) 00010000:00010000:2.0:1790946678.659477:0:14472:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b800/0x16e41aef932731d6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946678.659489:0:14472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b800/0x16e41aef932731d6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946678.659520:0:14472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b800/0x16e41aef932731d6 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946678.659549:0:14472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790946678.659625:0:14472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be978e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d8c7f7a5-9948-489b-83db-1b4a989e21d4+11:2363:x1877943286615808:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 246us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946678.659632:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 10 00010000:00010000:3.0:1790946678.660485:0:16113:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b800/0x16e41aef932731d6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.660500:0:16113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b800/0x16e41aef932731d6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.660534:0:16113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a600/0x16e41aef932731dd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.660548:0:16113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a600/0x16e41aef932731dd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.660559:0:16113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a600/0x16e41aef932731dd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.663632:0:16113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ba00/0x16e41aef932731e4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.663660:0:16113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ba00/0x16e41aef932731e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.663672:0:16113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ba00/0x16e41aef932731e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790946678.663704:0:16113:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1790946678.663751:0:16113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b800/0x16e41aef932731d6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.663760:0:16113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b800/0x16e41aef932731d6 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.663767:0:16113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b800/0x16e41aef932731d6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.663773:0:16113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146a032b800 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946678.663779:0:16113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b800/0x16e41aef932731d6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.663786:0:16113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b800/0x16e41aef932731d6 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.663799:0:16113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9146836dfc00) 00010000:00010000:3.0:1790946678.663802:0:16113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946678.664131:0:16113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b800/0x16e41aef932731d6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.664140:0:16113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b800/0x16e41aef932731d6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790946678.664157:0:16113:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000396504c4 reply state 00000000fdc977e8 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a600/0x16e41aef932731dd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946678.664166:0:16113:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1790946678.664496:0:16113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ac00/0x16e41aef932731cf lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d152 expref: 14 pid: 16113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.664531:0:16113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ba00/0x16e41aef932731e4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d152 expref: 13 pid: 16113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.664539:0:16113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9146836df400) 00010000:00010000:3.0:1790946678.664542:0:16113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1790946678.664545:0:16113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146a032ba00, rc 0) 00000100:00100000:2.0:1790946678.664761:0:16113:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be97b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:367257b9-14b9-4792-8ebc-8eea5a9ade3a+14:14442:x1877943286615680:12345-192.168.203.13@tcp:101:bash.0 Request processed in 16003us (16271us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1790946678.664772:0:16113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 28 00010000:00010000:2.0:1790946678.669437:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a600/0x16e41aef932731dd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946678.669461:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a600/0x16e41aef932731dd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946678.669471:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a600/0x16e41aef932731dd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946678.669477:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146a032a600 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:2.0:1790946678.669484:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a600/0x16e41aef932731dd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946678.669493:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a600/0x16e41aef932731dd lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946678.669513:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9146836df900) 00010000:00010000:2.0:1790946678.669517:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790946678.669523:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a600/0x16e41aef932731dd lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946678.669556:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032a600/0x16e41aef932731dd lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946678.687978:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946678.688486:0:14486:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286615936 00000100:00100000:3.0:1790946678.688502:0:14486:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286615936 00000100:00100000:3.0:1790946678.688582:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 29 00000100:00100000:3.0:1790946678.688594:0:14486:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91469829f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:367257b9-14b9-4792-8ebc-8eea5a9ade3a+13:14442:x1877943286615936:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:3.0:1790946678.689860:0:14486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790946678.689899:0:14486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ac00/0x16e41aef932731f2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0d159 expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.689999:0:14486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b800/0x16e41aef932731f9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.690017:0:14486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b800/0x16e41aef932731f9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.690031:0:14486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b800/0x16e41aef932731f9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790946678.690080:0:14486:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1790946678.690085:0:14486:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790946678.690108:0:14486:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b800/0x16e41aef932731f9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.690144:0:14486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b800/0x16e41aef932731f9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.690178:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ac00/0x16e41aef932731f2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d159 expref: 15 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.690248:0:14486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b800/0x16e41aef932731f9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d159 expref: 14 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946678.691681:0:14486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9146836df400) 00010000:00010000:3.0:1790946678.691692:0:14486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790946678.691699:0:14486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146a032b800, rc 0) 00000100:00100000:2.0:1790946678.692065:0:14486:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91469829f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:367257b9-14b9-4792-8ebc-8eea5a9ade3a+14:14442:x1877943286615936:12345-192.168.203.13@tcp:101:bash.0 Request processed in 3464us (4094us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946678.692077:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 29 00000100:00100000:1.0:1790946678.704159:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946678.704498:0:14489:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286616192 00000100:00100000:3.0:1790946678.704512:0:14489:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286616192 00000100:00100000:3.0:1790946678.704596:0:14489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:3.0:1790946678.704608:0:14489:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be979880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:367257b9-14b9-4792-8ebc-8eea5a9ade3a+14:14442:x1877943286616192:12345-192.168.203.13@tcp:35:bash.0 00000100:00100000:3.0:1790946678.705275:0:14489:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be979880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:367257b9-14b9-4792-8ebc-8eea5a9ade3a+15:14442:x1877943286616192:12345-192.168.203.13@tcp:35:bash.0 Request processed in 664us (1126us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1790946678.705286:0:14489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:1.0:1790946678.833815:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946678.836827:0:14487:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286616448 00000100:00100000:0.0:1790946678.836868:0:14487:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286616448 00000100:00100000:0.0:1790946678.837038:0:14487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 30 00000100:00100000:0.0:1790946678.837052:0:14487:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be978700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:367257b9-14b9-4792-8ebc-8eea5a9ade3a+15:14452:x1877943286616448:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1790946678.837116:0:14487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946678.837143:0:14487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933000/0x16e41aef93273200 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0d160 expref: -99 pid: 14487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790946678.837321:0:14487:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1790946678.837771:0:14487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933000/0x16e41aef93273200 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d160 expref: 17 pid: 14487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946678.837789:0:14487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91469e29d300) 00010000:00010000:0.0:1790946678.837793:0:14487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790946678.837806:0:14487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933000/0x16e41aef93273200 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d160 expref: 17 pid: 14487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946678.838152:0:14487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b1933000, rc 0) 00000100:00100000:0.0:1790946678.838406:0:14487:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be978700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:367257b9-14b9-4792-8ebc-8eea5a9ade3a+16:14452:x1877943286616448:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 1354us (4605us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1790946678.838450:0:14487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 30 00000100:00100000:0.0:1790946678.854360:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946678.854589:0:14489:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286616704 00000100:00100000:3.0:1790946678.854603:0:14489:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286616704 00000100:00100000:3.0:1790946678.854680:0:14489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:3.0:1790946678.854690:0:14489:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91469829c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:367257b9-14b9-4792-8ebc-8eea5a9ade3a+16:14452:x1877943286616704:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:3.0:1790946678.855159:0:14489:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91469829c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:367257b9-14b9-4792-8ebc-8eea5a9ade3a+17:14452:x1877943286616704:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 468us (814us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1790946678.855168:0:14489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:3.0:1790946678.924474:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946678.924652:0:14488:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286616960 00000100:00100000:2.0:1790946678.924665:0:14488:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286616960 00000100:00100000:2.0:1790946678.924760:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 31 00000100:00100000:2.0:1790946678.924772:0:14488:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5eb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:367257b9-14b9-4792-8ebc-8eea5a9ade3a+17:14455:x1877943286616960:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1790946678.924806:0:14488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946678.924831:0:14488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef9327320e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0d167 expref: -99 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946678.924969:0:14488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef93273215 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946678.924987:0:14488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef93273215 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946678.925001:0:14488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef93273215 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790946678.925016:0:14488:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790946678.925181:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef9327320e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d167 expref: 20 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946678.926636:0:14488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef93273215 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d167 expref: 19 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946678.926680:0:14488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9146836df400) 00010000:00010000:2.0:1790946678.926684:0:14488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790946678.926688:0:14488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914688aef200, rc 0) 00000100:00100000:2.0:1790946678.926823:0:14488:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5eb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:367257b9-14b9-4792-8ebc-8eea5a9ade3a+19:14455:x1877943286616960:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 2051us (2362us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1790946678.926834:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 31 00000100:00100000:3.0:1790946678.931019:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946678.931070:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946678.931276:0:14471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286617216 00000100:00100000:0.0:1790946678.931290:0:14471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286617216 00000100:00100000:0.0:1790946678.931393:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:0.0:1790946678.931405:0:14471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5eb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:367257b9-14b9-4792-8ebc-8eea5a9ade3a+19:2364:x1877943286617216:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790946678.931426:0:14471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790946678.931471:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aef200/0x16e41aef93273215 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d167 expref: 19 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946678.931494:0:14471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9146836df400) 00010000:00010000:0.0:1790946678.931499:0:14471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790946678.931575:0:14471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5eb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:367257b9-14b9-4792-8ebc-8eea5a9ade3a+18:2364:x1877943286617216:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 172us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946678.931584:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:2.0:1790946678.931743:0:16113:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286617088 00000100:00100000:2.0:1790946678.931749:0:16113:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286617088 00000100:00100000:2.0:1790946678.931792:0:16113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 32 00000100:00100000:2.0:1790946678.931802:0:16113:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5eb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:367257b9-14b9-4792-8ebc-8eea5a9ade3a+18:14455:x1877943286617088:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:2.0:1790946678.931885:0:16113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef93273223 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946678.931903:0:16113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef93273223 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946678.931925:0:16113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef93273223 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946678.931959:0:16113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef93273223 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946678.931967:0:16113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef93273223 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946678.931975:0:16113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef93273223 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946678.931982:0:16113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aeec00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:2.0:1790946678.932006:0:16113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef93273223 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946678.932015:0:16113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef93273223 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946678.932026:0:16113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9146836df400) 00010000:00010000:2.0:1790946678.932029:0:16113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790946678.932033:0:16113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef93273223 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946678.932040:0:16113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef93273223 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946678.932086:0:16113:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5eb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:367257b9-14b9-4792-8ebc-8eea5a9ade3a+18:14455:x1877943286617088:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 286us (1082us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946678.932094:0:16113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 32 00000100:00100000:1.0:1790946678.936174:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946678.936833:0:14489:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286617472 00000100:00100000:3.0:1790946678.937030:0:14489:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286617472 00000100:00100000:3.0:1790946678.937116:0:14489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:3.0:1790946678.937127:0:14489:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be97a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:367257b9-14b9-4792-8ebc-8eea5a9ade3a+18:14455:x1877943286617472:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:3.0:1790946678.938792:0:14489:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be97a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:367257b9-14b9-4792-8ebc-8eea5a9ade3a+19:14455:x1877943286617472:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 1653us (2616us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1790946678.938812:0:14489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 7 00010000:00010000:2.0:1790946678.961151:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946679.252433:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946679.255377:0:14488:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286617728 00000100:00100000:2.0:1790946679.255392:0:14488:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286617728 00000100:00100000:2.0:1790946679.255490:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 33 00000100:00100000:2.0:1790946679.255502:0:14488:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5eb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:367257b9-14b9-4792-8ebc-8eea5a9ade3a+19:14486:x1877943286617728:12345-192.168.203.13@tcp:101:cat.0 00010000:00010000:2.0:1790946679.255526:0:14488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946679.255547:0:14488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef9327322a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0d16e expref: -99 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946679.255640:0:14488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefe00/0x16e41aef93273231 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946679.255655:0:14488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefe00/0x16e41aef93273231 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946679.255680:0:14488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefe00/0x16e41aef93273231 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790946679.255694:0:14488:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790946679.255849:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef9327322a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d16e expref: 22 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946679.255868:0:14488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefe00/0x16e41aef93273231 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d16e expref: 21 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946679.255877:0:14488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9146836df400) 00010000:00010000:2.0:1790946679.255880:0:14488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790946679.255883:0:14488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914688aefe00, rc 0) 00000100:00100000:2.0:1790946679.255948:0:14488:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5eb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:367257b9-14b9-4792-8ebc-8eea5a9ade3a+21:14486:x1877943286617728:12345-192.168.203.13@tcp:101:cat.0 Request processed in 449us (3529us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1790946679.255956:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 33 00000100:00080000:0.0:1790946679.256020:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790946679.261391:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946679.261485:0:14490:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286617984 00000100:00100000:0.0:1790946679.261496:0:14490:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286617984 00000100:00100000:0.0:1790946679.261560:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:0.0:1790946679.261569:0:14490:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be97a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:367257b9-14b9-4792-8ebc-8eea5a9ade3a+21:14486:x1877943286617984:12345-192.168.203.13@tcp:35:cat.0 00000100:00100000:0.0:1790946679.261919:0:14490:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be97a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:367257b9-14b9-4792-8ebc-8eea5a9ade3a+22:14486:x1877943286617984:12345-192.168.203.13@tcp:35:cat.0 Request processed in 350us (535us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1790946679.261927:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:1.0:1790946679.266393:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946679.268111:0:14473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286618112 00000100:00100000:3.0:1790946679.268126:0:14473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286618112 00000100:00100000:3.0:1790946679.268289:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 1 00000100:00100000:3.0:1790946679.268418:0:14473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be97ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:367257b9-14b9-4792-8ebc-8eea5a9ade3a+22:2364:x1877943286618112:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790946679.268434:0:14473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790946679.268457:0:14473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefe00/0x16e41aef93273231 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d16e expref: 22 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946679.268476:0:14473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9146836df400) 00010000:00010000:3.0:1790946679.268480:0:14473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790946679.268578:0:14473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be97ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:367257b9-14b9-4792-8ebc-8eea5a9ade3a+21:2364:x1877943286618112:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 162us (2194us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946679.268585:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 1 00000100:00100000:1.0:1790946679.344361:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946679.345062:0:16113:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286618368 00000100:00100000:2.0:1790946679.345076:0:16113:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286618368 00000100:00100000:2.0:1790946679.345148:0:16113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 34 00000100:00100000:2.0:1790946679.345168:0:16113:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be979500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:367257b9-14b9-4792-8ebc-8eea5a9ade3a+21:14492:x1877943286618368:12345-192.168.203.13@tcp:101:dd.0 00010000:00010000:2.0:1790946679.345193:0:16113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946679.345239:0:16113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef9327323f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0d175 expref: -99 pid: 16113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946679.345335:0:16113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93273246 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946679.345367:0:16113:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ba00/0x16e41aef932731e4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d152 expref: 22 pid: 16113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946679.345376:0:16113:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b800/0x16e41aef932731f9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d159 expref: 22 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946679.345383:0:16113:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93273246 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946679.345417:0:16113:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b800/0x16e41aef932731f9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d159 expref: 22 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946679.345431:0:16113:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b800/0x16e41aef932731f9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d159 expref: 22 pid: 14486 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946679.345452:0:16113:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5a69c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16113:1877943303383424:192.168.203.13@tcp:104: 00010000:00010000:2.0:1790946679.345559:0:16113:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ba00/0x16e41aef932731e4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d152 expref: 22 pid: 16113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946679.345568:0:16113:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ba00/0x16e41aef932731e4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d152 expref: 22 pid: 16113 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946679.345576:0:16113:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5a6b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16113:1877943303383552:192.168.203.13@tcp:104: 00000100:00100000:2.0:1790946679.345599:0:16113:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146879c7480 going to sleep for 11 seconds 00000100:00100000:1.0:1790946679.353354:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946679.353425:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946679.353540:0:14471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286618496 00000100:00100000:0.0:1790946679.353555:0:14471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286618496 00010000:00010000:0.0:1790946679.353615:0:14471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b800/0x16e41aef932731f9 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d159 expref: 23 pid: 14486 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946679.353665:0:14471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286618624 00000100:00100000:0.0:1790946679.353669:0:14471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286618624 00010000:00010000:0.0:1790946679.353682:0:14471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ba00/0x16e41aef932731e4 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d152 expref: 24 pid: 16113 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946679.353698:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:0.0:1790946679.353707:0:14471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914584abcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:367257b9-14b9-4792-8ebc-8eea5a9ade3a+24:2363:x1877943286618496:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790946679.353731:0:14471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790946679.353737:0:14471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b800/0x16e41aef932731f9 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d159 expref: 24 pid: 14486 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.353749:0:14471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b800/0x16e41aef932731f9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d159 expref: 24 pid: 14486 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.353779:0:14471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9146836df400) 00010000:00010000:0.0:1790946679.353784:0:14471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93273246 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.353791:0:14471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93273246 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.353797:0:14471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790946679.353866:0:14471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914584abcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:367257b9-14b9-4792-8ebc-8eea5a9ade3a+24:2363:x1877943286618496:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 159us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946679.353873:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:3.0:1790946679.353955:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:3.0:1790946679.353985:0:14473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be97bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:367257b9-14b9-4792-8ebc-8eea5a9ade3a+23:2363:x1877943286618624:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790946679.354019:0:14473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790946679.354029:0:14473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ba00/0x16e41aef932731e4 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d152 expref: 23 pid: 16113 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946679.354046:0:14473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ba00/0x16e41aef932731e4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d152 expref: 23 pid: 16113 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946679.354068:0:14473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9146836df400) 00010000:00010000:3.0:1790946679.354074:0:14473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93273246 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946679.354085:0:14473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93273246 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946679.354094:0:14473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93273246 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946679.354116:0:14473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790946679.354170:0:14473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be97bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:367257b9-14b9-4792-8ebc-8eea5a9ade3a+23:2363:x1877943286618624:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 192us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946679.354179:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 12 00010000:00010000:2.0:1790946679.358484:0:16113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032b800/0x16e41aef932731f9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d159 expref: 22 pid: 14486 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946679.358550:0:16113:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5a69c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16113:1877943303383424:192.168.203.13@tcp:104: 00010000:00010000:2.0:1790946679.358573:0:16113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146a032ba00/0x16e41aef932731e4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d152 expref: 21 pid: 16113 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946679.358583:0:16113:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5a6b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16113:1877943303383552:192.168.203.13@tcp:104: 00010000:00010000:2.0:1790946679.358736:0:16113:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93273246 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946679.358748:0:16113:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93273246 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946679.358754:0:16113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93273246 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790946679.358780:0:16113:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790946679.359131:0:16113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef9327323f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d175 expref: 22 pid: 16113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946679.359152:0:16113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aee600/0x16e41aef93273246 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d175 expref: 21 pid: 16113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946679.359163:0:16113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9146836df400) 00010000:00010000:2.0:1790946679.359166:0:16113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790946679.359171:0:16113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914688aee600, rc 0) 00000100:00100000:2.0:1790946679.359342:0:16113:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be979500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:367257b9-14b9-4792-8ebc-8eea5a9ade3a+21:14492:x1877943286618368:12345-192.168.203.13@tcp:101:dd.0 Request processed in 14183us (15006us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1790946679.359366:0:16113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 34 00000100:00100000:1.0:1790946679.365806:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946679.365969:0:14486:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286618880 00000100:00100000:0.0:1790946679.365984:0:14486:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286618880 00000100:00100000:0.0:1790946679.366075:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 35 00000100:00100000:0.0:1790946679.366087:0:14486:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be979180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:367257b9-14b9-4792-8ebc-8eea5a9ade3a+21:14492:x1877943286618880:12345-192.168.203.13@tcp:36:dd.0 00010000:00010000:0.0:1790946679.369034:0:14486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932a00/0x16e41aef93273254 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.369067:0:14486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932a00/0x16e41aef93273254 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.369081:0:14486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932a00/0x16e41aef93273254 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790946679.369236:0:14486:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1790946679.369301:0:14486:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000077ffa741 reply state 00000000761e910b transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932a00/0x16e41aef93273254 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946679.370319:0:14486:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790946679.370877:0:14486:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be979180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:367257b9-14b9-4792-8ebc-8eea5a9ade3a+24:14492:x1877943286618880:12345-192.168.203.13@tcp:36:dd.0 Request processed in 4784us (5078us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1790946679.370889:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 35 00000020:00080000:0.0:1790946679.370897:0:14486:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790946679.382338:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932a00/0x16e41aef93273254 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946679.382362:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932a00/0x16e41aef93273254 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946679.382370:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932a00/0x16e41aef93273254 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946679.382402:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1932a00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:3.0:1790946679.382409:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932a00/0x16e41aef93273254 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946679.382417:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932a00/0x16e41aef93273254 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946679.382441:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9146836df400) 00010000:00010000:3.0:1790946679.382444:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790946679.382450:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932a00/0x16e41aef93273254 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946679.382456:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932a00/0x16e41aef93273254 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946679.382852:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946679.383024:0:14487:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286619008 00000100:00100000:0.0:1790946679.383039:0:14487:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286619008 00000100:00100000:0.0:1790946679.383121:0:14487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 36 00000100:00100000:0.0:1790946679.383132:0:14487:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be978a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:367257b9-14b9-4792-8ebc-8eea5a9ade3a+23:14492:x1877943286619008:12345-192.168.203.13@tcp:101:dd.0 00010000:00010000:0.0:1790946679.383163:0:14487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946679.383187:0:14487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933000/0x16e41aef9327325b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0d17c expref: -99 pid: 14487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.383287:0:14487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933000/0x16e41aef9327325b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d17c expref: 24 pid: 14487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.383318:0:14487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933000/0x16e41aef9327325b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d17c expref: 24 pid: 14487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.383342:0:14487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9146836df400) 00010000:00010000:0.0:1790946679.383346:0:14487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790946679.383349:0:14487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b1933000, rc 0) 00000100:00100000:0.0:1790946679.383431:0:14487:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be978a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:367257b9-14b9-4792-8ebc-8eea5a9ade3a+24:14492:x1877943286619008:12345-192.168.203.13@tcp:101:dd.0 Request processed in 301us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946679.383439:0:14487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 36 00000100:00100000:0.0:1790946679.399475:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946679.399630:0:14471:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286619264 00000100:00100000:3.0:1790946679.399642:0:14471:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286619264 00000100:00100000:3.0:1790946679.399738:0:14471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 2 00000100:00100000:3.0:1790946679.399750:0:14471:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91469829d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:367257b9-14b9-4792-8ebc-8eea5a9ade3a+24:14492:x1877943286619264:12345-192.168.203.13@tcp:103:dd.0 00010000:00010000:3.0:1790946679.399771:0:14471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790946679.399803:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933000/0x16e41aef9327325b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d17c expref: 24 pid: 14487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946679.399830:0:14471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9146836df400) 00010000:00010000:3.0:1790946679.399837:0:14471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790946679.399976:0:14471:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91469829d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:367257b9-14b9-4792-8ebc-8eea5a9ade3a+23:14492:x1877943286619264:12345-192.168.203.13@tcp:103:dd.0 Request processed in 227us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946679.399985:0:14471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 2 00000100:00100000:3.0:1790946679.402910:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946679.403019:0:14488:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286619392 00000100:00100000:1.0:1790946679.403032:0:14488:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286619392 00000100:00100000:1.0:1790946679.403111:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 37 00000100:00100000:1.0:1790946679.403265:0:14488:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5eb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:367257b9-14b9-4792-8ebc-8eea5a9ade3a+23:14492:x1877943286619392:12345-192.168.203.13@tcp:58:dd.0 00010000:00010000:1.0:1790946679.403556:0:14488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef93273262 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.403579:0:14488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef93273262 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.403594:0:14488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef93273262 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790946679.404996:0:14488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790946679.405647:0:14488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1790946679.405974:0:14488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1790946679.406151:0:14488:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5eb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:367257b9-14b9-4792-8ebc-8eea5a9ade3a+23:14492:x1877943286619392:12345-192.168.203.13@tcp:58:dd.0 Request processed in 2881us (3248us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946679.406164:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 37 00000100:00100000:1.0:1790946679.409883:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946679.412053:0:14487:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286619520 00000100:00100000:0.0:1790946679.412078:0:14487:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286619520 00000100:00100000:0.0:1790946679.412377:0:14487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 38 00000100:00100000:0.0:1790946679.412390:0:14487:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:367257b9-14b9-4792-8ebc-8eea5a9ade3a+23:14492:x1877943286619520:12345-192.168.203.13@tcp:101:dd.0 00010000:00010000:0.0:1790946679.412422:0:14487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790946679.412450:0:14487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef93273269 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0d183 expref: -99 pid: 14487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.412638:0:14487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef93273262 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.412652:0:14487:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef93273269 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d183 expref: 24 pid: 14487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.412677:0:14487:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef93273262 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.412728:0:14487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef93273269 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d183 expref: 24 pid: 14487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.412746:0:14487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9146836df400) 00010000:00010000:0.0:1790946679.412749:0:14487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790946679.412753:0:14487:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef93273269 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d183 expref: 24 pid: 14487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.412763:0:14487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b1933200, rc 0) 00000100:00100000:0.0:1790946679.412865:0:14487:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:367257b9-14b9-4792-8ebc-8eea5a9ade3a+24:14492:x1877943286619520:12345-192.168.203.13@tcp:101:dd.0 Request processed in 476us (2996us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946679.412873:0:14487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 38 00000040:00080000:3.0:1790946679.538057:0:14517:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1790946679.538072:0:14517:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790946679.538145:0:14517:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1790946679.538153:0:14517:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1790946679.538363:0:14517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146b5eb2680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14517:1877943303383680:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790946679.538503:0:14517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9146848473c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790946679.549781:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946679.550157:0:14497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286619648 00000100:00100000:2.0:1790946679.550170:0:14497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286619648 00000100:00100000:2.0:1790946679.550271:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:2.0:1790946679.550283:0:14497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be978380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:367257b9-14b9-4792-8ebc-8eea5a9ade3a+25:14493:x1877943286619648:12345-192.168.203.13@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1790946679.550521:0:14497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be978380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:367257b9-14b9-4792-8ebc-8eea5a9ade3a+25:14493:x1877943286619648:12345-192.168.203.13@tcp:900:lhsmtool_posix.0 Request processed in 239us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946679.550530:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:3.0:1790946679.550816:0:14517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146b5eb2680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14517:1877943303383680:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790946679.557007:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946679.558695:0:14486:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286619776 00000100:00100000:1.0:1790946679.558729:0:14486:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286619776 00000100:00100000:1.0:1790946679.558817:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 39 00000100:00100000:1.0:1790946679.558829:0:14486:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91469829df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:367257b9-14b9-4792-8ebc-8eea5a9ade3a+24:14493:x1877943286619776:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790946679.558878:0:14486:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790946679.559046:0:14486:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91469829df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:367257b9-14b9-4792-8ebc-8eea5a9ade3a+24:14493:x1877943286619776:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 218us (2052us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946679.559056:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 39 00000100:00100000:0.0:1790946679.565222:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946679.566083:0:16113:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286619904 00000100:00100000:1.0:1790946679.566099:0:16113:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286619904 00000100:00100000:1.0:1790946679.566178:0:16113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 40 00000100:00100000:1.0:1790946679.566189:0:16113:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91469829ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:367257b9-14b9-4792-8ebc-8eea5a9ade3a+24:14493:x1877943286619904:12345-192.168.203.13@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1790946679.566497:0:16113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fe00/0x16e41aef93273270 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.566519:0:16113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fe00/0x16e41aef93273270 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.566534:0:16113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fe00/0x16e41aef93273270 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.567088:0:16113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e000/0x16e41aef93273277 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.567112:0:16113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e000/0x16e41aef93273277 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.567125:0:16113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e000/0x16e41aef93273277 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.567159:0:16113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f200/0x16e41aef9327327e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.567168:0:16113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f200/0x16e41aef9327327e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.567175:0:16113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f200/0x16e41aef9327327e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790946679.567256:0:16113:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1790946679.567261:0:16113:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790946679.567274:0:16113:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f200/0x16e41aef9327327e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.567286:0:16113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fe00/0x16e41aef93273270 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.567307:0:16113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fe00/0x16e41aef93273270 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.567314:0:16113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fe00/0x16e41aef93273270 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.567320:0:16113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180fe00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:1.0:1790946679.567325:0:16113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fe00/0x16e41aef93273270 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.567333:0:16113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fe00/0x16e41aef93273270 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.567345:0:16113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91469e29d100) 00010000:00010000:1.0:1790946679.567348:0:16113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790946679.567352:0:16113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fe00/0x16e41aef93273270 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.567359:0:16113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fe00/0x16e41aef93273270 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.567375:0:16113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e000/0x16e41aef93273277 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.567381:0:16113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e000/0x16e41aef93273277 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.567387:0:16113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e000/0x16e41aef93273277 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.567392:0:16113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180e000 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:1.0:1790946679.567400:0:16113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e000/0x16e41aef93273277 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.567407:0:16113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e000/0x16e41aef93273277 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.567415:0:16113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff91469e29d900) 00010000:00010000:1.0:1790946679.567417:0:16113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790946679.567420:0:16113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e000/0x16e41aef93273277 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.567426:0:16113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e000/0x16e41aef93273277 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.567443:0:16113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f200/0x16e41aef9327327e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.567449:0:16113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f200/0x16e41aef9327327e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.567455:0:16113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f200/0x16e41aef9327327e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.567460:0:16113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180f200 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:1.0:1790946679.567463:0:16113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f200/0x16e41aef9327327e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.567469:0:16113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f200/0x16e41aef9327327e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.567476:0:16113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9146836df400) 00010000:00010000:1.0:1790946679.567478:0:16113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790946679.567488:0:16113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f200/0x16e41aef9327327e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.567494:0:16113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f200/0x16e41aef9327327e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946679.567600:0:16113:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91469829ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:367257b9-14b9-4792-8ebc-8eea5a9ade3a+24:14493:x1877943286619904:12345-192.168.203.13@tcp:34:lhsmtool_posix.0 Request processed in 1409us (2411us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946679.567611:0:16113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 40 00000100:00100000:3.0:1790946679.571640:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946679.572910:0:14486:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286620160 00000100:00100000:1.0:1790946679.572925:0:14486:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286620160 00000100:00100000:1.0:1790946679.573006:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 41 00000100:00100000:1.0:1790946679.573016:0:14486:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5eb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:367257b9-14b9-4792-8ebc-8eea5a9ade3a+24:14493:x1877943286620160:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790946679.573037:0:14486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946679.573056:0:14486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e200/0x16e41aef93273285 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0d18a expref: -99 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.573146:0:14486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef9327328c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.573159:0:14486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef9327328c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.573170:0:14486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef9327328c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790946679.573181:0:14486:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1790946679.573303:0:14486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef9327328c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.573313:0:14486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef9327328c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.573333:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef9327328c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.573340:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180e600 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:1.0:1790946679.573345:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef9327328c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.573355:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef9327328c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.573367:0:14486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9146836df400) 00010000:00010000:1.0:1790946679.573371:0:14486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790946679.573374:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef9327328c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.573380:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef9327328c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.573425:0:14486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e200/0x16e41aef93273285 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d18a expref: 26 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.573434:0:14486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91469e29d100) 00010000:00010000:1.0:1790946679.573436:0:14486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790946679.573440:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e200/0x16e41aef93273285 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d18a expref: 26 pid: 14486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.573448:0:14486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b180e200, rc 0) 00000100:00100000:1.0:1790946679.573515:0:14486:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5eb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:367257b9-14b9-4792-8ebc-8eea5a9ade3a+25:14493:x1877943286620160:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 501us (2326us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1790946679.573534:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 41 00000100:00100000:0.0:1790946679.576781:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946679.576914:0:14487:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286620288 00000100:00100000:1.0:1790946679.576927:0:14487:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286620288 00000100:00100000:1.0:1790946679.577010:0:14487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 42 00000100:00100000:1.0:1790946679.577020:0:14487:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91469829e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:367257b9-14b9-4792-8ebc-8eea5a9ade3a+25:14493:x1877943286620288:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790946679.577068:0:14487:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790946679.577273:0:14487:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91469829e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:367257b9-14b9-4792-8ebc-8eea5a9ade3a+25:14493:x1877943286620288:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 254us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946679.577282:0:14487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 42 00000100:00100000:0.0:1790946679.582111:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946679.582242:0:14488:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286620544 00000100:00100000:2.0:1790946679.582253:0:14488:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286620544 00000100:00100000:2.0:1790946679.582313:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 43 00000100:00100000:2.0:1790946679.582323:0:14488:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91469829d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:367257b9-14b9-4792-8ebc-8eea5a9ade3a+25:14493:x1877943286620544:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790946679.582344:0:14488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946679.582362:0:14488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef9327329a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0d191 expref: -99 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790946679.583053:0:14488:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =28 00000004:00080000:2.0:1790946679.583061:0:14488:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+28 in llog 00000004:00080000:2.0:1790946679.583106:0:14488:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:2.0:1790946679.583388:0:14488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeee00/0x16e41aef932732a1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946679.583403:0:14488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeee00/0x16e41aef932732a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946679.583414:0:14488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeee00/0x16e41aef932732a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946679.583495:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef9327329a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d191 expref: 28 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946679.583514:0:14488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeee00/0x16e41aef932732a1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d191 expref: 27 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946679.583523:0:14488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9146a0a5eb00) 00010000:00010000:2.0:1790946679.583526:0:14488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790946679.583529:0:14488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914688aeee00, rc 0) 00000100:00100000:2.0:1790946679.583612:0:14488:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91469829d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:367257b9-14b9-4792-8ebc-8eea5a9ade3a+27:14493:x1877943286620544:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 1290us (1509us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1790946679.583620:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 43 00000100:00100000:3.0:1790946679.590968:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946679.591887:0:14487:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286620800 00000100:00100000:1.0:1790946679.591904:0:14487:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286620800 00000100:00100000:1.0:1790946679.591975:0:14487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 44 00000100:00100000:1.0:1790946679.591986:0:14487:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5eb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:367257b9-14b9-4792-8ebc-8eea5a9ade3a+27:14493:x1877943286620800:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790946679.592045:0:14487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790946679.592070:0:14487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeee00/0x16e41aef932732a1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d191 expref: 27 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.592091:0:14487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9146a0a5eb00) 00010000:00010000:1.0:1790946679.592101:0:14487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790946679.592121:0:14487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e200/0x16e41aef932732af lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.592133:0:14487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e200/0x16e41aef932732af lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.592142:0:14487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e200/0x16e41aef932732af lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.592171:0:14487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef932732b6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x620eefa0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.592178:0:14487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef932732b6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x620eefa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.592185:0:14487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef932732b6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x620eefa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.592284:0:14487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e200/0x16e41aef932732af lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.592291:0:14487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e200/0x16e41aef932732af lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.592297:0:14487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e200/0x16e41aef932732af lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.592302:0:14487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180e200 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:1.0:1790946679.592307:0:14487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e200/0x16e41aef932732af lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.592314:0:14487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e200/0x16e41aef932732af lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.592322:0:14487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9146836dfc00) 00010000:00010000:1.0:1790946679.592325:0:14487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790946679.592329:0:14487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e200/0x16e41aef932732af lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.592334:0:14487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e200/0x16e41aef932732af lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.592352:0:14487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef932732b6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x620eefa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.592357:0:14487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef932732b6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x620eefa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.592362:0:14487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef932732b6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x620eefa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.592368:0:14487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180e600 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:1.0:1790946679.592370:0:14487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef932732b6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x620eefa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.592377:0:14487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef932732b6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x620eefa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.592383:0:14487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x620eefa0 (ffff91469e29d900) 00010000:00010000:1.0:1790946679.592386:0:14487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790946679.592389:0:14487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef932732b6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x620eefa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.592394:0:14487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef932732b6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x620eefa0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946679.592477:0:14487:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5eb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:367257b9-14b9-4792-8ebc-8eea5a9ade3a+26:14493:x1877943286620800:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 492us (1523us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790946679.592484:0:14487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 44 00000100:00100000:0.0:1790946679.595601:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946679.595688:0:14488:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286620928 00000100:00100000:2.0:1790946679.595698:0:14488:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286620928 00000100:00100000:2.0:1790946679.595775:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 45 00000100:00100000:2.0:1790946679.595784:0:14488:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91469829ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:367257b9-14b9-4792-8ebc-8eea5a9ade3a+26:14493:x1877943286620928:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790946679.595805:0:14488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946679.595826:0:14488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef932732bd lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0d198 expref: -99 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946679.595859:0:14488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefe00/0x16e41aef932732c4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946679.595872:0:14488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefe00/0x16e41aef932732c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946679.595881:0:14488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefe00/0x16e41aef932732c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946679.595979:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef932732bd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d198 expref: 28 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946679.595996:0:14488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aefe00/0x16e41aef932732c4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d198 expref: 27 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946679.596006:0:14488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9146a0a5e900) 00010000:00010000:2.0:1790946679.596009:0:14488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790946679.596011:0:14488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914688aefe00, rc 0) 00000100:00100000:2.0:1790946679.596073:0:14488:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91469829ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:367257b9-14b9-4792-8ebc-8eea5a9ade3a+27:14493:x1877943286620928:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 289us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946679.596080:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 45 00000100:00100000:0.0:1790946679.608453:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946679.610982:0:14487:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286621184 00000100:00100000:1.0:1790946679.610996:0:14487:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286621184 00000100:00100000:1.0:1790946679.611315:0:14487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 46 00000100:00100000:1.0:1790946679.611341:0:14487:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91469829e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:367257b9-14b9-4792-8ebc-8eea5a9ade3a+27:14493:x1877943286621184:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790946679.611430:0:14487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef932732cb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.611448:0:14487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef932732cb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.611460:0:14487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef932732cb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790946679.615411:0:14487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:1.0:1790946679.615434:0:14487:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 464687231924ns, next at 465687227160ns, rc = 0 00000004:00010000:1.0:1790946679.615543:0:14487:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000027667fb9 reply state 0000000070390c6c transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef932732cb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946679.615555:0:14487:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790946679.615659:0:14487:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91469829e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:367257b9-14b9-4792-8ebc-8eea5a9ade3a+29:14493:x1877943286621184:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 4317us (7212us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1790946679.615678:0:14487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 46 00010000:00010000:2.0:1790946679.621789:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef932732cb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946679.621805:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef932732cb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946679.621813:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef932732cb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946679.621819:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180e600 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:2.0:1790946679.621823:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef932732cb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946679.621830:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef932732cb lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946679.621847:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9146a0a5e900) 00010000:00010000:2.0:1790946679.621862:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790946679.621868:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef932732cb lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946679.621874:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e600/0x16e41aef932732cb lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946679.626181:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946679.626333:0:14488:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286621312 00000100:00100000:2.0:1790946679.626343:0:14488:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286621312 00000100:00100000:2.0:1790946679.626409:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 47 00000100:00100000:2.0:1790946679.626419:0:14488:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91469829fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:367257b9-14b9-4792-8ebc-8eea5a9ade3a+28:14493:x1877943286621312:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790946679.626443:0:14488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790946679.626464:0:14488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef932732d2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0d19f expref: -99 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946679.626522:0:14488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef932732d2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d19f expref: 29 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946679.626538:0:14488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef932732d2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d19f expref: 29 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946679.626558:0:14488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9146a0a5e900) 00010000:00010000:2.0:1790946679.626562:0:14488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790946679.626565:0:14488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff914688aeec00, rc 0) 00000100:00100000:2.0:1790946679.626636:0:14488:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91469829fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:367257b9-14b9-4792-8ebc-8eea5a9ade3a+29:14493:x1877943286621312:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 218us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946679.626643:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 47 00000100:00100000:3.0:1790946679.634010:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946679.634175:0:15170:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286621440 00000100:00100000:0.0:1790946679.634186:0:15170:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286621440 00000100:00100000:0.0:1790946679.634284:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:0.0:1790946679.634294:0:15170:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5eb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:367257b9-14b9-4792-8ebc-8eea5a9ade3a+5:2363:x1877943286621440:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1790946679.634654:0:15170:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5eb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:367257b9-14b9-4792-8ebc-8eea5a9ade3a+6:2363:x1877943286621440:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 Request processed in 360us (653us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1790946679.634678:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00080000:2.0:1790946679.634905:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790946679.638634:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946679.639155:0:14490:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286621696 00000100:00100000:0.0:1790946679.639166:0:14490:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286621696 00000100:00100000:0.0:1790946679.639251:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:0.0:1790946679.639261:0:14490:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:367257b9-14b9-4792-8ebc-8eea5a9ade3a+29:14493:x1877943286621696:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1790946679.639495:0:14490:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:367257b9-14b9-4792-8ebc-8eea5a9ade3a+30:14493:x1877943286621696:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 235us (869us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1790946679.639503:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:1.0:1790946679.650181:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946679.650525:0:16113:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286621952 00000100:00100000:2.0:1790946679.650551:0:16113:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286621952 00000100:00100000:2.0:1790946679.650608:0:16113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 48 00000100:00100000:2.0:1790946679.650617:0:16113:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be97b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:367257b9-14b9-4792-8ebc-8eea5a9ade3a+30:14493:x1877943286621952:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1790946679.650733:0:16113:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be97b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:367257b9-14b9-4792-8ebc-8eea5a9ade3a+30:14493:x1877943286621952:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 116us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946679.650741:0:16113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 48 00000100:00100000:2.0:1790946679.654186:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946679.654297:0:14488:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286622080 00000100:00100000:1.0:1790946679.654307:0:14488:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286622080 00000100:00100000:1.0:1790946679.654367:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 49 00000100:00100000:1.0:1790946679.654387:0:14488:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5a6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:367257b9-14b9-4792-8ebc-8eea5a9ade3a+30:14493:x1877943286622080:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790946679.654409:0:14488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946679.654429:0:14488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f200/0x16e41aef932732d9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0d1a6 expref: -99 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.654502:0:14488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e000/0x16e41aef932732e0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.654529:0:14488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e000/0x16e41aef932732e0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.654540:0:14488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e000/0x16e41aef932732e0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790946679.654577:0:14488:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790946679.654594:0:14488:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e000/0x16e41aef932732e0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.654618:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180f200/0x16e41aef932732d9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d1a6 expref: 32 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.654636:0:14488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e000/0x16e41aef932732e0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d1a6 expref: 31 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.654644:0:14488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9146a0a5e900) 00010000:00010000:1.0:1790946679.654647:0:14488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1790946679.654650:0:14488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b180e000, rc 0) 00000100:00100000:1.0:1790946679.654721:0:14488:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5a6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:367257b9-14b9-4792-8ebc-8eea5a9ade3a+31:14493:x1877943286622080:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 335us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946679.654728:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 49 00000100:00100000:3.0:1790946679.659631:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946679.659758:0:15171:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286622208 00000100:00100000:1.0:1790946679.659768:0:15171:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286622208 00000100:00100000:1.0:1790946679.659815:0:15171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:1.0:1790946679.659824:0:15171:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5eb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:367257b9-14b9-4792-8ebc-8eea5a9ade3a+6:2364:x1877943286622208:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790946679.659842:0:15171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790946679.659874:0:15171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e13b794/0x16e41aef932732e7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x826f92adbe0d1ad expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790946679.659901:0:15171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abfad77, blocks: 0x1 00010000:00010000:1.0:1790946679.659919:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=464s v=(0 0) 00010000:00010000:1.0:1790946679.659924:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946679.659950:0:15171:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e13b794/0x16e41aef932732e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d1ad expref: 7 pid: 15171 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.659970:0:15171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006e13b794/0x16e41aef932732e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d1ad expref: 7 pid: 15171 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.659984:0:15171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9146b180f200, rc 0) 00000100:00100000:1.0:1790946679.660040:0:15171:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5eb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:367257b9-14b9-4792-8ebc-8eea5a9ade3a+7:2364:x1877943286622208:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 216us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946679.660048:0:15171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:2.0:1790946679.665665:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946679.665749:0:16113:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286622464 00000100:00100000:1.0:1790946679.665761:0:16113:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286622464 00000100:00100000:1.0:1790946679.665817:0:16113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 50 00000100:00100000:1.0:1790946679.665826:0:16113:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5a69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:367257b9-14b9-4792-8ebc-8eea5a9ade3a+31:14493:x1877943286622464:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1790946679.665944:0:16113:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5a69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:367257b9-14b9-4792-8ebc-8eea5a9ade3a+31:14493:x1877943286622464:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 118us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946679.665951:0:16113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 50 00000100:00100000:2.0:1790946679.670329:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946679.670463:0:14488:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286622592 00000100:00100000:1.0:1790946679.670472:0:14488:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286622592 00000100:00100000:1.0:1790946679.670529:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 51 00000100:00100000:1.0:1790946679.670539:0:14488:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5a6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:367257b9-14b9-4792-8ebc-8eea5a9ade3a+31:14493:x1877943286622592:12345-192.168.203.13@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1790946679.743189:0:5857:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:3.0:1790946679.743241:0:5857:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000004:00080000:3.0:1790946679.743255:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:3.0:1790946679.743277:0:5857:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:2.0:1790946679.743647:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790946679.743667:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be97b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303383808:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1790946679.743749:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946679.743863:0:15168:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303383808 00000100:00100000:1.0:1790946679.743871:0:15168:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303383808 00000100:00100000:1.0:1790946679.743919:0:15168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790946679.743928:0:15168:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5a6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1877943303383808:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1790946679.744088:0:15168:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1790946679.744091:0:15168:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1790946679.744093:0:15168:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1790946679.744096:0:15168:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1790946679 -> 1790946679 00002000:00010000:1.0:1790946679.744098:0:15168:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1790946679.744142:0:15168:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5a6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3301:x1877943303383808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 215us (393us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1790946679.744148:0:15168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:2.0:1790946679.744244:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9146be97b480/2, rc 0, transno 8589934595 00000100:00100000:2.0:1790946679.744251:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be97b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1877943303383808:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1790946679.750084:0:14488:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5a6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:367257b9-14b9-4792-8ebc-8eea5a9ade3a+14:14493:x1877943286622592:12345-192.168.203.13@tcp:44:lhsmtool_posix.0 Request processed in 79537us (79756us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946679.750097:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 51 00000100:00100000:3.0:1790946679.762734:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946679.764297:0:15170:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286622720 00000100:00100000:0.0:1790946679.764312:0:15170:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286622720 00000100:00100000:0.0:1790946679.764382:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:0.0:1790946679.764393:0:15170:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5eb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:367257b9-14b9-4792-8ebc-8eea5a9ade3a+7:2363:x1877943286622720:12345-192.168.203.13@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1790946679.764509:0:15170:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5eb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:367257b9-14b9-4792-8ebc-8eea5a9ade3a+7:2363:x1877943286622720:12345-192.168.203.13@tcp:16:lhsmtool_posix.0 Request processed in 118us (1784us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946679.764517:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:1.0:1790946679.770028:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946679.770192:0:16113:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286622976 00000100:00100000:2.0:1790946679.770237:0:16113:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286622976 00000100:00100000:2.0:1790946679.770290:0:16113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 52 00000100:00100000:2.0:1790946679.770301:0:16113:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be97aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:367257b9-14b9-4792-8ebc-8eea5a9ade3a+14:14493:x1877943286622976:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790946679.770360:0:16113:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790946679.770390:0:16113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180e000/0x16e41aef932732e0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d1a6 expref: 14 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946679.770412:0:16113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9146a0a5e900) 00010000:00010000:2.0:1790946679.770417:0:16113:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790946679.770448:0:16113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeee00/0x16e41aef932732ee lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946679.770480:0:16113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeee00/0x16e41aef932732ee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946679.770489:0:16113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeee00/0x16e41aef932732ee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790946679.770764:0:16113:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000000ea62ec4 reply state 000000008591be5e transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeee00/0x16e41aef932732ee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946679.770773:0:16113:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790946679.770986:0:16113:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be97aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:367257b9-14b9-4792-8ebc-8eea5a9ade3a+15:14493:x1877943286622976:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 686us (966us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1790946679.770994:0:16113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 52 00010000:00010000:0.0:1790946679.776054:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeee00/0x16e41aef932732ee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.776071:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeee00/0x16e41aef932732ee lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.776078:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeee00/0x16e41aef932732ee lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.776083:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aeee00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:0.0:1790946679.776088:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeee00/0x16e41aef932732ee lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.776109:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeee00/0x16e41aef932732ee lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.776126:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9146a0a5e900) 00010000:00010000:0.0:1790946679.776129:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790946679.776135:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeee00/0x16e41aef932732ee lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.776141:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeee00/0x16e41aef932732ee lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946679.777290:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946679.777389:0:15171:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286623104 00000100:00100000:2.0:1790946679.777401:0:15171:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286623104 00000100:00100000:2.0:1790946679.777469:0:15171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:2.0:1790946679.777485:0:15171:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be978e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:367257b9-14b9-4792-8ebc-8eea5a9ade3a+7:2363:x1877943286623104:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1790946679.777697:0:15171:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1790946679.777700:0:15171:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1790946678 00002000:00010000:2.0:1790946679.777703:0:15171:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1790946678 00002000:00010000:2.0:1790946679.777705:0:15171:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1790946679 -> 1790946678 00002000:00010000:2.0:1790946679.777707:0:15171:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1790946679.777781:0:15171:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be978e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:367257b9-14b9-4792-8ebc-8eea5a9ade3a+8:2363:x1877943286623104:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 Request processed in 297us (503us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1790946679.777789:0:15171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:2.0:1790946679.785367:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946679.788834:0:15168:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286623232 00000100:00100000:1.0:1790946679.788857:0:15168:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286623232 00000100:00100000:1.0:1790946679.789030:0:15168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:1.0:1790946679.789043:0:15168:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5a68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:367257b9-14b9-4792-8ebc-8eea5a9ade3a+8:2363:x1877943286623232:12345-192.168.203.13@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1790946679.789102:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fb13ef42/0x16e41aef932732f5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.789123:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946679.789129:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946679.789136:0:15168:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb13ef42/0x16e41aef932732f5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.789153:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb13ef42/0x16e41aef932732f5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.789233:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fb13ef42/0x16e41aef932732f5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.789244:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb13ef42/0x16e41aef932732f5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.789253:0:15168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb13ef42/0x16e41aef932732f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.789260:0:15168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180e000 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:1.0:1790946679.789265:0:15168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb13ef42/0x16e41aef932732f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.789275:0:15168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb13ef42/0x16e41aef932732f5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.789293:0:15168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb13ef42/0x16e41aef932732f5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.789301:0:15168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb13ef42/0x16e41aef932732f5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946679.789438:0:15168:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5a68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:367257b9-14b9-4792-8ebc-8eea5a9ade3a+8:2363:x1877943286623232:12345-192.168.203.13@tcp:1:lhsmtool_posix.0 Request processed in 396us (4084us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946679.789458:0:15168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:3.0:1790946679.791682:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946679.791796:0:14486:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286623488 00000100:00100000:0.0:1790946679.791812:0:14486:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286623488 00000100:00100000:0.0:1790946679.791885:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 53 00000100:00100000:0.0:1790946679.791895:0:14486:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5eb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:367257b9-14b9-4792-8ebc-8eea5a9ade3a+14:14493:x1877943286623488:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1790946679.791987:0:14486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933000/0x16e41aef932732fc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.792005:0:14486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933000/0x16e41aef932732fc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.792016:0:14486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933000/0x16e41aef932732fc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.793788:0:14486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932a00/0x16e41aef93273303 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.793811:0:14486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef932732d2 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d19f expref: 15 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.793834:0:14486:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932a00/0x16e41aef93273303 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.793870:0:14486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef932732d2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d19f expref: 15 pid: 14488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.793885:0:14486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef932732d2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d19f expref: 15 pid: 14488 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946679.793897:0:14486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91469829d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14486:1877943303383936:192.168.203.13@tcp:104: 00000100:00100000:0.0:1790946679.793998:0:14486:0:(client.c:2716:ptlrpc_set_wait()) set ffff914683162480 going to sleep for 11 seconds 00000100:00100000:3.0:1790946679.800187:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946679.800404:0:14473:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286623616 00000100:00100000:1.0:1790946679.800417:0:14473:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286623616 00010000:00010000:1.0:1790946679.800475:0:14473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef932732d2 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d19f expref: 16 pid: 14488 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946679.800519:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:1.0:1790946679.800530:0:14473:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5eb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:367257b9-14b9-4792-8ebc-8eea5a9ade3a+16:2363:x1877943286623616:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790946679.800547:0:14473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790946679.800555:0:14473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef932732d2 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d19f expref: 16 pid: 14488 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.800570:0:14473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef932732d2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d19f expref: 16 pid: 14488 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.800599:0:14473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9146a0a5e900) 00010000:00010000:1.0:1790946679.800605:0:14473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932a00/0x16e41aef93273303 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.800618:0:14473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932a00/0x16e41aef93273303 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.800627:0:14473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932a00/0x16e41aef93273303 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946679.800661:0:14473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790946679.800743:0:14473:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5eb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:367257b9-14b9-4792-8ebc-8eea5a9ade3a+16:2363:x1877943286623616:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 214us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946679.800773:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 13 00010000:00010000:0.0:1790946679.802754:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff914688aeec00/0x16e41aef932732d2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d19f expref: 15 pid: 14488 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946679.802792:0:14486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91469829d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14486:1877943303383936:192.168.203.13@tcp:104: 00010000:00010000:0.0:1790946679.802817:0:14486:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932a00/0x16e41aef93273303 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.802827:0:14486:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932a00/0x16e41aef93273303 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.802833:0:14486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932a00/0x16e41aef93273303 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790946679.803010:0:14486:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1790946679.803158:0:14486:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1790946679.803326:0:14486:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1790946679.803434:0:14486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91469829d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14486:1877943303384064:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1790946679.803531:0:14486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946679.803563:0:14486:0:(client.c:2716:ptlrpc_set_wait()) set ffff9145879aa240 going to sleep for 11 seconds 00000100:00100000:3.0:1790946679.803638:0:14491:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303384064 00000100:00100000:3.0:1790946679.803656:0:14491:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303384064 00000100:00100000:3.0:1790946679.803796:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790946679.803808:0:14491:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91469829dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14486:x1877943303384064:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1790946679.804031:0:14491:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91469829dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14486:x1877943303384064:12345-0@lo:1000:mdt00_000.0 Request processed in 226us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946679.804040:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790946679.804525:0:14486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91469829d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14486:1877943303384064:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1790946679.808083:0:14486:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:0.0:1790946679.808259:0:14486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91469829ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14486:1877943303384192:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1790946679.808351:0:14486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946679.808403:0:14486:0:(client.c:2716:ptlrpc_set_wait()) set ffff9145879aad80 going to sleep for 11 seconds 00000100:00100000:3.0:1790946679.808480:0:14491:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303384192 00000100:00100000:3.0:1790946679.808489:0:14491:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303384192 00000100:00100000:3.0:1790946679.808550:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790946679.808561:0:14491:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91469829d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14486:x1877943303384192:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1790946679.809720:0:14491:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91469829d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14486:x1877943303384192:12345-0@lo:1000:mdt00_000.0 Request processed in 1135us (1343us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1790946679.809734:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790946679.810628:0:14486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91469829ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14486:1877943303384192:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1790946679.810697:0:14486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932a00/0x16e41aef93273303 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.810719:0:14486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932a00/0x16e41aef93273303 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.810728:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932a00/0x16e41aef93273303 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.810736:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1932a00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:0.0:1790946679.810742:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932a00/0x16e41aef93273303 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.810752:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932a00/0x16e41aef93273303 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.810769:0:14486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9146a0a5e900) 00010000:00010000:0.0:1790946679.810773:0:14486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790946679.810779:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932a00/0x16e41aef93273303 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.810786:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1932a00/0x16e41aef93273303 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.810855:0:14486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef93273262 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.810862:0:14486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef93273262 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.810869:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef93273262 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.810874:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180fa00 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:0.0:1790946679.810877:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef93273262 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.810883:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef93273262 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.810891:0:14486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9146836df400) 00010000:00010000:0.0:1790946679.810893:0:14486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790946679.810901:0:14486:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef93273269 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d183 expref: 18 pid: 14487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.810915:0:14486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef93273269 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d183 expref: 18 pid: 14487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.810925:0:14486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef93273269 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d183 expref: 18 pid: 14487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.810999:0:14486:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933200/0x16e41aef93273269 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d183 expref: 18 pid: 14487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946679.811028:0:14486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91469829f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14486:1877943303384320:192.168.203.13@tcp:105: 00000100:00100000:0.0:1790946679.811145:0:14486:0:(client.c:2716:ptlrpc_set_wait()) set ffff9145879aaa80 going to sleep for 11 seconds 00000100:00100000:0.0:1790946679.817279:0:14486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91469829f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14486:1877943303384320:192.168.203.13@tcp:105: 00010000:00010000:0.0:1790946679.817323:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef93273262 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.817336:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b180fa00/0x16e41aef93273262 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.817383:0:14486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933400/0x16e41aef9327330a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.817411:0:14486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933400/0x16e41aef9327330a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.817426:0:14486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933400/0x16e41aef9327330a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.817441:0:14486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933400/0x16e41aef9327330a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.817447:0:14486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933400/0x16e41aef9327330a lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.817454:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933400/0x16e41aef9327330a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.817459:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1933400 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:0.0:1790946679.817463:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933400/0x16e41aef9327330a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.817491:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933400/0x16e41aef9327330a lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.817504:0:14486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9146836df400) 00010000:00010000:0.0:1790946679.817508:0:14486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790946679.817512:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933400/0x16e41aef9327330a lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.817518:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933400/0x16e41aef9327330a lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.817529:0:14486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933000/0x16e41aef932732fc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.817535:0:14486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933000/0x16e41aef932732fc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.817542:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933000/0x16e41aef932732fc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.817547:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1933000 already unused, calling callback (ffffffffc21be4f0) 00010000:00010000:0.0:1790946679.817550:0:14486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933000/0x16e41aef932732fc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.817556:0:14486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933000/0x16e41aef932732fc lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.817564:0:14486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9146836df400) 00010000:00010000:0.0:1790946679.817566:0:14486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790946679.817569:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933000/0x16e41aef932732fc lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.817585:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933000/0x16e41aef932732fc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946679.817918:0:14486:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5eb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:367257b9-14b9-4792-8ebc-8eea5a9ade3a+18:14493:x1877943286623488:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 26021us (26245us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1790946679.817930:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 53 00000020:00080000:0.0:1790946679.817938:0:14486:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1790946679.819224:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000040:00080000:3.0:1790946679.819336:0:14517:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1790946679.819342:0:14517:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1790946679.819363:0:14490:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286623744 00000100:00100000:0.0:1790946679.819374:0:14490:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286623744 00000040:00080000:3.0:1790946679.819377:0:14517:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1790946679.819386:0:14517:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1790946679.819502:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:0.0:1790946679.819514:0:14490:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5fcdc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:367257b9-14b9-4792-8ebc-8eea5a9ade3a+18:14492:x1877943286623744:12345-192.168.203.13@tcp:49:dd.0 00000100:00100000:0.0:1790946679.819818:0:14490:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5fcdc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:367257b9-14b9-4792-8ebc-8eea5a9ade3a+18:14492:x1877943286623744:12345-192.168.203.13@tcp:49:dd.0 Request processed in 305us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946679.819826:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:2.0:1790946679.838265:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946679.842137:0:14490:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286624000 00000100:00100000:0.0:1790946679.842155:0:14490:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286624000 00000100:00100000:0.0:1790946679.842242:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:0.0:1790946679.842253:0:14490:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146c1cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:367257b9-14b9-4792-8ebc-8eea5a9ade3a+18:14493:x1877943286624000:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1790946679.843249:0:14490:0:(mdd_object.c:4180:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1790946679.843446:0:14490:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1790946679.843490:0:14490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933000/0x16e41aef93273311 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.843506:0:14490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933000/0x16e41aef93273311 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.843523:0:14490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933000/0x16e41aef93273311 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.843538:0:14490:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933000/0x16e41aef93273311 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.843545:0:14490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933000/0x16e41aef93273311 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.843551:0:14490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933000/0x16e41aef93273311 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946679.843578:0:14490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1790946679.843680:0:14490:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146c1cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:367257b9-14b9-4792-8ebc-8eea5a9ade3a+20:14493:x1877943286624000:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 1427us (5426us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1790946679.843689:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 11 00000020:00080000:0.0:1790946679.843695:0:14490:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790946679.844070:0:14475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790946679.844078:0:14475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933000/0x16e41aef93273311 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946679.844141:0:14475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1933000 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:2.0:1790946679.844145:0:14475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933000/0x16e41aef93273311 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946679.844153:0:14475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933000/0x16e41aef93273311 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946679.844164:0:14475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9146a0a5e900) 00010000:00010000:2.0:1790946679.844167:0:14475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1790946679.844171:0:14475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933000/0x16e41aef93273311 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946679.844176:0:14475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9146b1933000/0x16e41aef93273311 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946679.844188:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946679.844190:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946679.844191:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946679.985196:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790946680.135561:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946680.135612:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1790946680.135671:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946680.135704:0:15174:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286624256 00000100:00100000:0.0:1790946680.135731:0:15174:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286624256 00000100:00100000:0.0:1790946680.135796:0:15174:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286624128 00000100:00100000:0.0:1790946680.135801:0:15174:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286624128 00000100:00100000:0.0:1790946680.135815:0:15174:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286624384 00000100:00100000:0.0:1790946680.135817:0:15174:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286624384 00000100:00100000:0.0:1790946680.135838:0:15174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:0.0:1790946680.135847:0:15174:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:367257b9-14b9-4792-8ebc-8eea5a9ade3a+10:2363:x1877943286624256:12345-192.168.203.13@tcp:4:dd.0 00010000:00010000:0.0:1790946680.137393:0:15174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000892c7a1b/0x16e41aef93273318 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946680.137425:0:15174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006e13b794/0x16e41aef932732e7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d1ad expref: 10 pid: 15171 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946680.137456:0:15174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1790946680.137461:0:15174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790946680.137465:0:15174:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000892c7a1b/0x16e41aef93273318 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946680.137511:0:15174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006e13b794/0x16e41aef932732e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d1ad expref: 10 pid: 15171 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946680.137527:0:15174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006e13b794/0x16e41aef932732e7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d1ad expref: 10 pid: 15171 timeout: 565 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946680.137544:0:15174:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91469829c380 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:15174:1877943303384448:192.168.203.13@tcp:104: 00000100:00100000:0.0:1790946680.137754:0:15174:0:(client.c:2716:ptlrpc_set_wait()) set ffff9145879aa480 going to sleep for 11 seconds 00000100:00100000:1.0:1790946680.152605:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1790946680.153371:0:15174:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91469829c380 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:15174:1877943303384448:192.168.203.13@tcp:104: 00010000:00010000:0.0:1790946680.153402:0:15174:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000892c7a1b/0x16e41aef93273318 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946680.154358:0:14472:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286624512 00000100:00100000:2.0:1790946680.154368:0:14472:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286624512 00010000:00010000:2.0:1790946680.154426:0:14472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006e13b794/0x16e41aef932732e7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d1ad expref: 11 pid: 15171 timeout: 565 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790946680.154467:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:2.0:1790946680.154477:0:14472:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146be97ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:367257b9-14b9-4792-8ebc-8eea5a9ade3a+11:2363:x1877943286624512:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790946680.154508:0:14472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790946680.154534:0:14472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006e13b794/0x16e41aef932732e7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d1ad expref: 11 pid: 15171 timeout: 565 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946680.154547:0:14472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006e13b794/0x16e41aef932732e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d1ad expref: 11 pid: 15171 timeout: 565 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946680.154570:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e13b794/0x16e41aef932732e7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x826f92adbe0d1ad expref: 11 pid: 15171 timeout: 565 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946680.154586:0:14472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790946680.154590:0:14472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790946680.154596:0:14472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000892c7a1b/0x16e41aef93273318 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946680.154607:0:14472:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000892c7a1b/0x16e41aef93273318 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946680.154641:0:14472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790946680.154715:0:14472:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146be97ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:367257b9-14b9-4792-8ebc-8eea5a9ade3a+10:2363:x1877943286624512:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 231us (2111us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946680.154723:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 14 00010000:00010000:0.0:1790946680.158445:0:15174:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000892c7a1b/0x16e41aef93273318 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946680.158466:0:15174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000892c7a1b/0x16e41aef93273318 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790946680.251579:0:6700:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000001:00080000:3.0:1790946680.251605:0:6700:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934595 is committed 00000001:00080000:3.0:1790946680.251616:0:6700:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00002000:00010000:1.0:1790946680.251713:0:15174:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:1.0:1790946680.251719:0:15174:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1790946678 -> 1790946679 00002000:00010000:1.0:1790946680.251721:0:15174:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2055 00010000:00010000:1.0:1790946680.251737:0:15174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000892c7a1b/0x16e41aef93273318 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946680.251751:0:15174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000892c7a1b/0x16e41aef93273318 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946680.251761:0:15174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000892c7a1b/0x16e41aef93273318 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946680.251770:0:15174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b1933400 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:1.0:1790946680.251775:0:15174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000892c7a1b/0x16e41aef93273318 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946680.251784:0:15174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000892c7a1b/0x16e41aef93273318 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946680.251803:0:15174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000892c7a1b/0x16e41aef93273318 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946680.251812:0:15174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000892c7a1b/0x16e41aef93273318 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946680.252133:0:15174:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:367257b9-14b9-4792-8ebc-8eea5a9ade3a+7:2363:x1877943286624256:12345-192.168.203.13@tcp:4:dd.0 Request processed in 116281us (116581us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1790946680.252149:0:15174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:1.0:1790946680.252182:0:15174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 1 00000100:00100000:1.0:1790946680.252194:0:15174:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:367257b9-14b9-4792-8ebc-8eea5a9ade3a+6:2364:x1877943286624128:12345-192.168.203.13@tcp:4:dd.0 00002000:00010000:1.0:1790946680.252333:0:15174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 2097152, mtime: 0x6abfad77, atime: 0x6abfad76, ctime: 0x0, blocks: 0x807 00010000:00010000:1.0:1790946680.252340:0:15174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004357f1f7/0x16e41aef9327331f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946680.252353:0:15174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=465s v=(0 0) 00010000:00010000:1.0:1790946680.252357:0:15174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946680.252363:0:15174:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004357f1f7/0x16e41aef9327331f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946680.252383:0:15174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004357f1f7/0x16e41aef9327331f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946680.304634:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790946680.304658:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91469829c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303384576:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790946680.304742:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946680.304857:0:15172:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303384576 00000100:00100000:0.0:1790946680.304877:0:15172:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303384576 00000100:00100000:0.0:1790946680.304961:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790946680.304971:0:15172:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beef3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303384576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790946680.305007:0:15172:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790946680.305057:0:15172:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beef3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1877943303384576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946680.305065:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1790946680.305073:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790946680.305111:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91469829c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1877943303384576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790946680.306660:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be97a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877943303384960:0@lo:400:kworker.0 00000100:00100000:0.0:1790946680.306724:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946680.306754:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790946680.306761:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be97a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1877943303385088:0@lo:400:kworker.0 00000100:00100000:0.0:1790946680.306781:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790946680.306811:0:14487:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303384960 00000100:00100000:0.0:1790946680.306818:0:14487:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303384960 00000100:00100000:0.0:1790946680.306851:0:14487:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303385088 00000100:00100000:0.0:1790946680.306853:0:14487:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303385088 00000100:00100000:0.0:1790946680.306881:0:14487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790946680.306887:0:14487:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91469829c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877943303384960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946680.307052:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be979f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:3302:1877943303384704:0@lo:400:kworker.0 00000100:00100000:3.0:1790946680.307314:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790946680.307324:0:14486:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff91469829f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1877943303385088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790946680.307379:0:14486:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91469829f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1877943303385088:12345-0@lo:400:kworker.0 Request processed in 57us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946680.307400:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1790946680.307423:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790946680.307633:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790946680.307675:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff914682eadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1877943303385216:0@lo:400:kworker.0 00000100:00100000:3.0:1790946680.307691:0:14478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303384704 00000100:00100000:3.0:1790946680.307698:0:14478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303384704 00000100:00100000:1.0:1790946680.307718:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946680.307743:0:14478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1790946680.307744:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790946680.307753:0:14478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5806c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+19:3302:x1877943303384704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790946680.307754:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146be979880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303384832:0@lo:400:kworker.0 00000100:00100000:3.0:1790946680.307795:0:14478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5806c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0b106ef3-c5bc-477a-ab83-2c0856d82eb3+19:3302:x1877943303384704:12345-0@lo:400:kworker.0 Request processed in 43us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946680.307802:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946680.307807:0:14478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1790946680.307837:0:14486:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303385216 00000100:00100000:3.0:1790946680.307841:0:14486:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303385216 00000100:00100000:1.0:1790946680.307841:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be979f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0b106ef3-c5bc-477a-ab83-2c0856d82eb3:3302:1877943303384704:0@lo:400:kworker.0 00000100:00100000:3.0:1790946680.307878:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790946680.307885:0:14486:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682eaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877943303385216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946680.308976:0:14487:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff91469829c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1877943303384960:12345-0@lo:400:kworker.0 Request processed in 2083us (2246us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946680.308985:0:14487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790946680.309018:0:15170:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303384832 00000100:00100000:0.0:1790946680.309022:0:15170:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303384832 00000100:00100000:0.0:1790946680.309060:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790946680.309068:0:15170:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682ead880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303384832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790946680.309114:0:15170:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682ead880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1877943303384832:12345-0@lo:400:kworker.0 Request processed in 47us (1315us total) trans 0 rc 0/0 00000100:00100000:0.0:1790946680.309130:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790946680.309162:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:0.0:1790946680.309168:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9146be97b480, transno 8589934595 00000004:00080000:0.0:1790946680.309178:0:3302:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:0.0:1790946680.309194:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be979880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1877943303384832:0@lo:400:kworker.0 00000100:00100000:3.0:1790946680.309578:0:14486:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682eaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1877943303385216:12345-0@lo:400:kworker.0 Request processed in 1691us (1869us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946680.309588:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1790946680.309612:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790946680.309616:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790946680.310876:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff914682eadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1877943303385216:0@lo:400:kworker.0 00000100:00100000:0.0:1790946680.310946:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be97a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1877943303385088:0@lo:400:kworker.0 00000100:00100000:0.0:1790946680.310958:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146be97a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1877943303384960:0@lo:400:kworker.0 00002000:00010000:1.0:1790946680.343882:0:15174:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 2055 -> 4103 00010000:00010000:1.0:1790946680.343903:0:15174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004357f1f7/0x16e41aef9327331f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946680.343916:0:15174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004357f1f7/0x16e41aef9327331f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946680.343926:0:15174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004357f1f7/0x16e41aef9327331f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946680.343933:0:15174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180e600 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:1.0:1790946680.343938:0:15174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004357f1f7/0x16e41aef9327331f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946680.343947:0:15174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004357f1f7/0x16e41aef9327331f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946680.343965:0:15174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004357f1f7/0x16e41aef9327331f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946680.344113:0:15174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004357f1f7/0x16e41aef9327331f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946680.344250:0:15174:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:367257b9-14b9-4792-8ebc-8eea5a9ade3a+8:2364:x1877943286624128:12345-192.168.203.13@tcp:4:dd.0 Request processed in 92056us (208632us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1790946680.344277:0:15174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 1 00000100:00100000:1.0:1790946680.344308:0:15174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 2 00000100:00100000:1.0:1790946680.344319:0:15174:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146beef0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:367257b9-14b9-4792-8ebc-8eea5a9ade3a+7:2363:x1877943286624384:12345-192.168.203.13@tcp:4:dd.0 00002000:00010000:1.0:1790946680.344356:0:15174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 2097152, mtime: 0x6abfad77, atime: 0x6abfad76, ctime: 0x0, blocks: 0x1007 00010000:00010000:1.0:1790946680.344362:0:15174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051d6df61/0x16e41aef93273326 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790946680.344598:0:6700:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00010000:00010000:1.0:1790946680.345655:0:15174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=465s v=(0 0) 00010000:00010000:1.0:1790946680.345664:0:15174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946680.345672:0:15174:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051d6df61/0x16e41aef93273326 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946680.345691:0:15174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051d6df61/0x16e41aef93273326 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790946680.422791:0:6700:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:1.0:1790946680.423065:0:15174:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:1.0:1790946680.423070:0:15174:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:1.0:1790946680.423083:0:15174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051d6df61/0x16e41aef93273326 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946680.423095:0:15174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051d6df61/0x16e41aef93273326 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946680.423104:0:15174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051d6df61/0x16e41aef93273326 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946680.423130:0:15174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180ea00 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:1.0:1790946680.423134:0:15174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051d6df61/0x16e41aef93273326 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946680.423143:0:15174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051d6df61/0x16e41aef93273326 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946680.423160:0:15174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051d6df61/0x16e41aef93273326 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946680.423167:0:15174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051d6df61/0x16e41aef93273326 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946680.423300:0:15174:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146beef0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:367257b9-14b9-4792-8ebc-8eea5a9ade3a+5:2363:x1877943286624384:12345-192.168.203.13@tcp:4:dd.0 Request processed in 78979us (287625us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1790946680.423310:0:15174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 2 00000100:00100000:1.0:1790946680.441300:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946680.441335:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946680.441375:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946680.441402:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946680.441420:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946680.441689:0:15176:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286624640 00000100:00100000:2.0:1790946680.441700:0:15176:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286624640 00000100:00100000:2.0:1790946680.441759:0:15176:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286624768 00000100:00100000:2.0:1790946680.441762:0:15176:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286624768 00000100:00100000:2.0:1790946680.441793:0:15176:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286624896 00000100:00100000:2.0:1790946680.441796:0:15176:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286624896 00000100:00100000:2.0:1790946680.441806:0:15176:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286625024 00000100:00100000:2.0:1790946680.441808:0:15176:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286625024 00000100:00100000:2.0:1790946680.441819:0:15176:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286625152 00000100:00100000:2.0:1790946680.441822:0:15176:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286625152 00000100:00100000:2.0:1790946680.441838:0:15176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 3 00000100:00100000:2.0:1790946680.441846:0:15176:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682eaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:367257b9-14b9-4792-8ebc-8eea5a9ade3a+9:2364:x1877943286624640:12345-192.168.203.13@tcp:4:dd.0 00002000:00010000:2.0:1790946680.441889:0:15176:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 3145728, mtime: 0x6abfad77, atime: 0x6abfad76, ctime: 0x0, blocks: 0x1807 00010000:00010000:2.0:1790946680.441898:0:15176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001251d2e1/0x16e41aef9327332d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946680.441913:0:15176:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=465s v=(0 0) 00010000:00010000:2.0:1790946680.441918:0:15176:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790946680.441925:0:15176:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001251d2e1/0x16e41aef9327332d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790946680.441937:0:15176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001251d2e1/0x16e41aef9327332d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790946680.526943:0:15176:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:1.0:1790946680.526953:0:15176:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1790946679 -> 1790946680 00002000:00010000:1.0:1790946680.526956:0:15176:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 0 -> 1790946680 00002000:00010000:1.0:1790946680.526958:0:15176:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:1.0:1790946680.526997:0:15176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001251d2e1/0x16e41aef9327332d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946680.527009:0:15176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001251d2e1/0x16e41aef9327332d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946680.527018:0:15176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001251d2e1/0x16e41aef9327332d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946680.527026:0:15176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff914688aeee00 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:1.0:1790946680.527031:0:15176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001251d2e1/0x16e41aef9327332d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946680.527040:0:15176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001251d2e1/0x16e41aef9327332d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946680.527060:0:15176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001251d2e1/0x16e41aef9327332d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946680.527067:0:15176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001251d2e1/0x16e41aef9327332d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790946680.527172:0:15176:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682eaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:367257b9-14b9-4792-8ebc-8eea5a9ade3a+11:2364:x1877943286624640:12345-192.168.203.13@tcp:4:dd.0 Request processed in 85322us (85876us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1790946680.527182:0:15176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 3 00000100:00100000:1.0:1790946680.527245:0:15176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:1.0:1790946680.527258:0:15176:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682eaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:367257b9-14b9-4792-8ebc-8eea5a9ade3a+10:2364:x1877943286624768:12345-192.168.203.13@tcp:4:dd.0 00002000:00010000:1.0:1790946680.527304:0:15176:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 4194304, mtime: 0x6abfad78, atime: 0x6abfad76, ctime: 0x6abfad78, blocks: 0x2007 00010000:00010000:1.0:1790946680.527310:0:15176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001841d622/0x16e41aef93273334 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946680.527321:0:15176:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=465s v=(0 0) 00010000:00010000:1.0:1790946680.527325:0:15176:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790946680.527331:0:15176:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001841d622/0x16e41aef93273334 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790946680.527343:0:15176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001841d622/0x16e41aef93273334 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790946680.531016:0:6700:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00002000:00010000:3.0:1790946680.612250:0:15176:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 4194304 -> 5242880 00002000:00010000:3.0:1790946680.612259:0:15176:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 10247 00010000:00010000:3.0:1790946680.612272:0:15176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001841d622/0x16e41aef93273334 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946680.612286:0:15176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001841d622/0x16e41aef93273334 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946680.612314:0:15176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001841d622/0x16e41aef93273334 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946680.612321:0:15176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146b180ee00 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:3.0:1790946680.612327:0:15176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001841d622/0x16e41aef93273334 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946680.612336:0:15176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001841d622/0x16e41aef93273334 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946680.612356:0:15176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001841d622/0x16e41aef93273334 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946680.612363:0:15176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001841d622/0x16e41aef93273334 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946680.612592:0:15176:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682eaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:367257b9-14b9-4792-8ebc-8eea5a9ade3a+10:2364:x1877943286624768:12345-192.168.203.13@tcp:4:dd.0 Request processed in 85334us (171250us total) trans 8589934602 rc 0/0 00000100:00100000:3.0:1790946680.612606:0:15176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:3.0:1790946680.612642:0:15176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:3.0:1790946680.612656:0:15176:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682eac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:367257b9-14b9-4792-8ebc-8eea5a9ade3a+9:2364:x1877943286624896:12345-192.168.203.13@tcp:4:dd.0 00002000:00010000:3.0:1790946680.612697:0:15176:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 5242880, mtime: 0x6abfad78, atime: 0x6abfad76, ctime: 0x6abfad78, blocks: 0x2807 00010000:00010000:3.0:1790946680.612713:0:15176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9b292c9/0x16e41aef9327333b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946680.612738:0:15176:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=465s v=(0 0) 00010000:00010000:3.0:1790946680.612744:0:15176:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790946680.612750:0:15176:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9b292c9/0x16e41aef9327333b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946680.612762:0:15176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9b292c9/0x16e41aef9327333b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790946680.613116:0:6700:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00000001:00080000:1.0:1790946680.668301:0:6700:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00002000:00010000:3.0:1790946680.668485:0:15176:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 5242880 -> 6291456 00002000:00010000:3.0:1790946680.668490:0:15176:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:3.0:1790946680.668504:0:15176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9b292c9/0x16e41aef9327333b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946680.668518:0:15176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9b292c9/0x16e41aef9327333b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946680.668528:0:15176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9b292c9/0x16e41aef9327333b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946680.668535:0:15176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146a032be00 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:3.0:1790946680.668540:0:15176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9b292c9/0x16e41aef9327333b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946680.668549:0:15176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9b292c9/0x16e41aef9327333b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946680.668586:0:15176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9b292c9/0x16e41aef9327333b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946680.668594:0:15176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9b292c9/0x16e41aef9327333b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946680.668695:0:15176:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682eac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:367257b9-14b9-4792-8ebc-8eea5a9ade3a+7:2364:x1877943286624896:12345-192.168.203.13@tcp:4:dd.0 Request processed in 56041us (227323us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1790946680.668714:0:15176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:3.0:1790946680.668745:0:15176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:3.0:1790946680.668754:0:15176:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682eae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:367257b9-14b9-4792-8ebc-8eea5a9ade3a+6:2364:x1877943286625024:12345-192.168.203.13@tcp:4:dd.0 00002000:00010000:3.0:1790946680.668791:0:15176:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 6291456, mtime: 0x6abfad78, atime: 0x6abfad76, ctime: 0x6abfad78, blocks: 0x3007 00010000:00010000:3.0:1790946680.668797:0:15176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f346c2cb/0x16e41aef93273342 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946680.668809:0:15176:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=465s v=(0 0) 00010000:00010000:3.0:1790946680.668814:0:15176:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790946680.668820:0:15176:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f346c2cb/0x16e41aef93273342 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946680.668833:0:15176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f346c2cb/0x16e41aef93273342 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790946680.761038:0:6700:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00002000:00010000:3.0:1790946680.761229:0:15176:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:3.0:1790946680.761234:0:15176:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:3.0:1790946680.761262:0:15176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f346c2cb/0x16e41aef93273342 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946680.761275:0:15176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f346c2cb/0x16e41aef93273342 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946680.761297:0:15176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f346c2cb/0x16e41aef93273342 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946680.761305:0:15176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146a032ac00 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:3.0:1790946680.761310:0:15176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f346c2cb/0x16e41aef93273342 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946680.761319:0:15176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f346c2cb/0x16e41aef93273342 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946680.761337:0:15176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f346c2cb/0x16e41aef93273342 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946680.761346:0:15176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f346c2cb/0x16e41aef93273342 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790946680.761444:0:15176:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682eae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:367257b9-14b9-4792-8ebc-8eea5a9ade3a+6:2364:x1877943286625024:12345-192.168.203.13@tcp:4:dd.0 Request processed in 92687us (320035us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1790946680.761454:0:15176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:3.0:1790946680.761481:0:15176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:3.0:1790946680.761492:0:15176:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682eaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:367257b9-14b9-4792-8ebc-8eea5a9ade3a+5:2364:x1877943286625152:12345-192.168.203.13@tcp:4:dd.0 00002000:00010000:3.0:1790946680.761536:0:15176:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 7340032, mtime: 0x6abfad78, atime: 0x6abfad76, ctime: 0x6abfad78, blocks: 0x3807 00010000:00010000:3.0:1790946680.761543:0:15176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9b292c9/0x16e41aef93273349 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946680.761553:0:15176:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=465s v=(0 0) 00010000:00010000:3.0:1790946680.761558:0:15176:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790946680.761564:0:15176:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9b292c9/0x16e41aef93273349 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790946680.761576:0:15176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9b292c9/0x16e41aef93273349 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790946680.811376:0:6700:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00002000:00010000:0.0:1790946680.811673:0:15176:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:0.0:1790946680.811678:0:15176:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:0.0:1790946680.811690:0:15176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9b292c9/0x16e41aef93273349 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946680.811773:0:15176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9b292c9/0x16e41aef93273349 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946680.811783:0:15176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9b292c9/0x16e41aef93273349 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946680.811790:0:15176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9146a032be00 already unused, calling callback (ffffffffc1749ac0) 00010000:00010000:0.0:1790946680.811794:0:15176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9b292c9/0x16e41aef93273349 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946680.811940:0:15176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9b292c9/0x16e41aef93273349 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946680.811961:0:15176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9b292c9/0x16e41aef93273349 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790946680.811969:0:15176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9b292c9/0x16e41aef93273349 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790946680.812108:0:15176:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682eaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:367257b9-14b9-4792-8ebc-8eea5a9ade3a+5:2364:x1877943286625152:12345-192.168.203.13@tcp:4:dd.0 Request processed in 50615us (370681us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1790946680.812117:0:15176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 7 00010000:00010000:2.0:1790946681.009946:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790946682.032423:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946682.592732:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946682.592773:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946682.592806:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946682.592830:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946682.592846:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946682.592861:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1790946682.592892:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1790946682.593174:0:16113:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286625408 00000100:00100000:2.0:1790946682.593183:0:16113:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286625408 00000100:00100000:2.0:1790946682.593269:0:16113:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286625792 00000100:00100000:2.0:1790946682.593273:0:16113:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286625792 00000100:00100000:2.0:1790946682.593296:0:16113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 29 00000100:00100000:2.0:1790946682.593306:0:16113:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682eac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:367257b9-14b9-4792-8ebc-8eea5a9ade3a+20:2362:x1877943286625408:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790946682.593393:0:16113:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682eac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:367257b9-14b9-4792-8ebc-8eea5a9ade3a+20:2362:x1877943286625408:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 88us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946682.593400:0:16113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 29 00000100:00100000:2.0:1790946682.593417:0:16113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 30 00000100:00100000:2.0:1790946682.593423:0:16113:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682eaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8c7f7a5-9948-489b-83db-1b4a989e21d4+6:2362:x1877943286625792:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1790946682.593450:0:16113:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682eaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8c7f7a5-9948-489b-83db-1b4a989e21d4+6:2362:x1877943286625792:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 26us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1790946682.593457:0:16113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 30 00000100:00080000:2.0:1790946682.593476:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790946682.593786:0:15168:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286625664 00000100:00100000:1.0:1790946682.593802:0:15168:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286625664 00000100:00100000:1.0:1790946682.593830:0:15168:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286625920 00000100:00100000:1.0:1790946682.593833:0:15168:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286625920 00000100:00100000:1.0:1790946682.593846:0:15168:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286625536 00000100:00100000:1.0:1790946682.593848:0:15168:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286625536 00000100:00100000:1.0:1790946682.593858:0:15168:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286626048 00000100:00100000:1.0:1790946682.593860:0:15168:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286626048 00000100:00100000:1.0:1790946682.593902:0:15168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:1.0:1790946682.593918:0:15168:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682eaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:367257b9-14b9-4792-8ebc-8eea5a9ade3a+5:2362:x1877943286625664:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790946682.593960:0:15168:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682eaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:367257b9-14b9-4792-8ebc-8eea5a9ade3a+5:2362:x1877943286625664:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 43us (1186us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946682.593967:0:15168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:1.0:1790946682.593979:0:15168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:1.0:1790946682.593985:0:15168:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682ead180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d8c7f7a5-9948-489b-83db-1b4a989e21d4+5:2362:x1877943286625920:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790946682.594005:0:15168:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682ead180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d8c7f7a5-9948-489b-83db-1b4a989e21d4+5:2362:x1877943286625920:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 21us (1199us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946682.594011:0:15168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:1.0:1790946682.594030:0:15168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:1.0:1790946682.594035:0:15168:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682eace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:367257b9-14b9-4792-8ebc-8eea5a9ade3a+5:2362:x1877943286625536:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790946682.594315:0:15168:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682eace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:367257b9-14b9-4792-8ebc-8eea5a9ade3a+5:2362:x1877943286625536:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 278us (1466us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946682.594321:0:15168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:1.0:1790946682.594334:0:15168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:1.0:1790946682.594340:0:15168:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682eadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d8c7f7a5-9948-489b-83db-1b4a989e21d4+5:2362:x1877943286626048:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790946682.594365:0:15168:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682eadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d8c7f7a5-9948-489b-83db-1b4a989e21d4+5:2362:x1877943286626048:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 25us (1472us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946682.594370:0:15168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:1.0:1790946682.594393:0:14480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943286625280 00000100:00100000:1.0:1790946682.594397:0:14480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943286625280 00000100:00100000:1.0:1790946682.594423:0:14480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 122 00000100:00100000:1.0:1790946682.594428:0:14480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff9146b5804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:297779ff-2cb2-4723-b8d5-25521c7fc733+13:2362:x1877943286625280:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1790946682.594461:0:14480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff9146b5804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:297779ff-2cb2-4723-b8d5-25521c7fc733+13:2362:x1877943286625280:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 32us (1630us total) trans 0 rc 0/0 00000100:00100000:1.0:1790946682.594467:0:14480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 122 00000100:00080000:2.0:1790946682.595901:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790946682.595915:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:0.0:1790946682.602803:0:16753:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:2.0:1790946683.056511:0:14475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790946683.378183:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9146beef3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303385344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790946683.378270:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790946683.378400:0:15172:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877943303385344 00000100:00100000:3.0:1790946683.378410:0:15172:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877943303385344 00000100:00100000:3.0:1790946683.378470:0:15172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790946683.378480:0:15172:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff914682ead500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877943303385344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790946683.378522:0:15172:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 6815744 granted 62980096 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1790946683.378565:0:15172:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff914682ead500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1877943303385344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1790946683.378572:0:15172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1790946683.378707:0:14482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790946683.379953:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9146beef3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1877943303385344:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1790946684.085001:0:14474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29627 lines, 29627 kept, 0 dropped, 0 bad.